-- Logs begin at Sat 2022-09-10 23:11:52 UTC, end at Sun 2022-09-11 00:22:09 UTC. -- Sep 10 23:51:51.834595 dv-cinder-852009-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 23:51:51.843342 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 23:51:51 2022] *** Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: nodename: dv-cinder-852009-6-iscsi Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: machine: x86_64 Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: clock source: unix Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: pcre jit disabled Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: detected number of CPU cores: 4 Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: current working directory: / Sep 10 23:51:51.845472 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: detected binary path: /usr/bin/uwsgi-core Sep 10 23:51:51.846213 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: your processes number limit is 47680 Sep 10 23:51:51.846213 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: your memory page size is 4096 bytes Sep 10 23:51:51.846213 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: detected max file descriptor number: 2048 Sep 10 23:51:51.846213 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: lock engine: pthread robust mutexes Sep 10 23:51:51.846213 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: thunder lock: enabled Sep 10 23:51:51.846213 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 23:51:51.846213 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 23:51:51.884826 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: Python main interpreter initialized at 0x5622ec9499c0 Sep 10 23:51:51.884826 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: python threads support enabled Sep 10 23:51:51.884826 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: your server socket listen backlog is limited to 100 connections Sep 10 23:51:51.884826 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: your mercy for graceful operations on workers is 90 seconds Sep 10 23:51:51.885148 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 23:51:51.885223 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: *** Operational MODE: preforking *** Sep 10 23:51:51.885485 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: *** uWSGI is running in multiple interpreter mode *** Sep 10 23:51:51.885485 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: spawned uWSGI master process (pid: 105830) Sep 10 23:51:51.885664 dv-cinder-852009-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 10 23:51:51.890794 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: spawned uWSGI worker 1 (pid: 105831, cores: 1) Sep 10 23:51:51.890794 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: spawned uWSGI worker 2 (pid: 105832, cores: 1) Sep 10 23:51:51.890794 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 23:51:52.557775 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 23:51:52.563834 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 23:51:53.652018 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 23:51:53.652018 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: from cryptography.utils import int_from_bytes Sep 10 23:51:53.652628 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 23:51:53.652628 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: from cryptography.utils import int_from_bytes Sep 10 23:51:53.652745 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 23:51:53.652745 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: from cryptography.utils import int_from_bytes Sep 10 23:51:53.653117 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 23:51:53.653117 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: from cryptography.utils import int_from_bytes Sep 10 23:51:56.150685 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 23:51:56.165697 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 23:51:56.165797 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 23:51:56.166185 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 23:51:56.166267 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 23:51:56.166344 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 23:51:56.166344 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 23:51:56.166487 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 23:51:56.166558 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.166628 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 23:51:56.166716 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.166793 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 23:51:56.166868 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.166934 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.166996 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167059 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167121 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167191 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167267 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167338 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167402 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167464 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167534 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167604 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167677 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167768 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167832 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167894 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.167965 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168030 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168092 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-6-iscsi {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168167 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168262 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168351 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168441 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168514 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-6-iscsi {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168583 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168656 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168721 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168792 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168862 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.168932 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169002 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169071 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169148 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169220 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169292 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169375 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169375 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169506 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169506 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169639 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169725 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169796 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169860 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169934 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.169999 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170070 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170135 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170197 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170266 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170337 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170407 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170476 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170540 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170608 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170719 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170799 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170799 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.170934 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-6-iscsi {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171008 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171082 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171082 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171203 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-6-iscsi {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171273 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171349 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171349 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171467 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171537 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171617 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171617 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171745 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.171881 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.172491 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.172491 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173111 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173111 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173236 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173311 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173383 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173459 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173531 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173596 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173667 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173731 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173794 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173870 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.173936 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174009 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174073 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174149 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174219 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174297 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174369 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174443 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174575 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.174648 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.175707 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.175796 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.175886 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.175982 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176070 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176157 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176241 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176325 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176402 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176487 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176565 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176655 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176734 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176815 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176903 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.176982 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177066 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177144 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177219 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177294 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177369 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177454 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177539 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177618 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177693 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177779 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.177863 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178002 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178095 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178180 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178263 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178340 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178464 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178555 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178633 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178749 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178842 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178923 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178998 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.178998 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179135 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179211 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179286 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179361 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179448 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179526 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179601 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179683 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179760 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179834 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.179921 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180006 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180089 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180172 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180254 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180337 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180494 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180573 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180659 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180736 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180811 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180886 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.180969 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181045 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181179 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181262 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181337 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181425 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181503 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181578 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181653 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181734 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181734 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181879 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.181956 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182030 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182111 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182188 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182188 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182339 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182416 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182502 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182635 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182776 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182857 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.182952 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183038 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183115 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183190 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183270 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183354 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183431 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183522 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183599 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183678 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183760 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183848 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.183933 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184009 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184091 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184167 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184241 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184328 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184420 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184577 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184676 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184878 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.184963 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.185180 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.185264 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.185481 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.185563 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.185779 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.185862 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.186079 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.186171 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.186381 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.186464 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.186717 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.186805 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.187011 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.187098 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.187311 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.187403 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.187938 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188082 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188201 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188295 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188383 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188468 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188586 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188670 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188852 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.188941 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.189404 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.189495 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.189704 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.189794 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.190001 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.190097 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.190305 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.190396 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.190604 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.190716 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.190937 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.191029 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.191232 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.191315 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.191530 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.191622 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.191831 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.191926 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.192131 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.192216 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.192430 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.192522 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.192728 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.192821 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.193027 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.193118 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.193323 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.193418 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.193619 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.193707 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.193918 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.194009 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.194218 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.194351 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.194515 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.194598 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.194837 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.194923 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.195155 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.195242 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.195458 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.195541 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.195762 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.195846 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.196064 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.196149 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.196378 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 23:51:56.196464 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.196709 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.196801 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.197037 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.197123 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.197358 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.197450 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.197670 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.197768 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.197989 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.198082 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.198311 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.198402 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.198619 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.198735 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.198952 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.199037 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.199261 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.199345 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.199576 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.199671 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.199882 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.199973 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.200188 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.200299 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.200496 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.200662 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.200808 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.200893 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.201119 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.201202 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.201426 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.201519 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.201743 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.201827 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.202051 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.202134 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.202368 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.202454 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.202714 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.202804 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.203010 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.203215 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.203596 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.203680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.203765 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.203843 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.203973 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.204069 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.204313 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.204400 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.204630 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.204724 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.204940 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.205025 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.205247 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.205333 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.205567 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.205650 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.205875 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.205968 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.206183 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.206267 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.206487 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.206572 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.206825 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.206924 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.207148 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.207240 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.207456 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.207541 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.207767 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.207858 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.208073 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.208156 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.208381 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.208464 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.208688 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.208837 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.208995 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.209106 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.209310 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.209440 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.209619 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.209757 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.209926 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.210073 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.210258 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.210386 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.210572 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.210711 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.210916 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.211026 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.211231 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.211338 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.211542 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.211648 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.211858 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.211950 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.212170 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.212254 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.212479 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.212565 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.212790 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.212875 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.213095 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.213179 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.213414 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.213509 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.213700 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.213799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.214005 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.214099 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.214307 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.214392 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.214624 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.214728 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.214957 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.215059 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.215267 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.215360 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.215577 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.215662 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.215883 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.215976 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.216191 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.216276 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.216498 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.216583 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.216802 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.216896 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.217103 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.217186 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.217415 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.217500 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.217721 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.217863 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.218042 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.218177 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.218344 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.218501 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.219181 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.219500 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.219935 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220019 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220104 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220190 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220277 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220363 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220570 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220656 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220879 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.220963 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.221186 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.221292 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.221498 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.221632 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.221806 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.221905 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.222114 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.222198 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.222432 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.222517 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.222766 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.222878 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.223077 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.223164 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.223400 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.223484 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.223715 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.223809 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.224016 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.224099 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.224338 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.224431 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.224640 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.224739 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.224945 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.225038 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.225245 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.225329 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.225548 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.225641 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.225849 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.225932 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.226149 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.226241 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.226446 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.226538 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.226775 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.226876 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.227078 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.227170 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.227379 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.227473 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.227681 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.227767 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.227980 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.228063 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.228279 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.228364 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.228578 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.228670 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.228890 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.228988 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.229192 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.229285 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.229494 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.229579 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.229799 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.229894 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.230138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.230231 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.230441 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.230525 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.230800 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.230902 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.231119 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.231205 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.231427 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.231511 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.231738 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.231845 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.232043 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.232127 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.232351 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.232443 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.232657 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.232754 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.232965 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.233059 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.233273 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.233365 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.233578 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.233663 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.233890 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.233973 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.234198 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.235488 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.235488 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.235740 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.235834 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.235914 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.235990 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.236066 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.236151 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.236236 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.236407 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.236501 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.236712 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.236805 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.237026 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.237120 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.237367 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.237460 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.237688 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.237781 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.237996 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.238081 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.238309 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.238393 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.238616 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.238735 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.238951 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.239036 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.239256 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.239340 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.239562 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.239660 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.239875 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.239966 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.240179 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.240264 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.240492 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.240589 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.240797 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.240881 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.241109 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.241200 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.241413 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.241513 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.241803 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.241902 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.242034 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.242118 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.242350 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.242435 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.242654 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.242802 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.242980 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.243054 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.243300 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.243395 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.243608 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.243700 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.243916 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.244007 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.244224 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.244308 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.244525 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.244609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.244828 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.244912 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.245132 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.245216 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.245439 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.245523 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.245743 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.245837 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.246047 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.246130 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.246350 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.246443 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.246676 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.246776 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.246985 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.247076 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.247287 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.247380 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.247587 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.247679 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.247894 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.247978 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.248197 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.248279 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.248499 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.248592 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.248801 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.248885 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.249110 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.249194 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.249410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.249494 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.249711 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.249795 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.250136 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.250623 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.250623 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.250816 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.250816 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.250953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.251052 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.251148 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.251375 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.251461 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.251683 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.251767 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.251989 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.252088 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.252289 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.252387 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.252590 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.252675 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.252926 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.253019 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.253231 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.253314 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.253532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.253625 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.253837 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.253931 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.254144 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.254237 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.254448 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.254531 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.254782 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.254883 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.255092 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.255178 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.255396 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.255479 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.255701 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.255798 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.256011 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.256095 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.256314 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.256407 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.256623 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.256710 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.256925 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.257017 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.257231 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.257323 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.257537 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.257625 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.257838 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.257929 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.258145 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.258228 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.258453 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.258539 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.258786 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.259060 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.259161 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.259389 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.259483 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.259700 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.259784 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.260317 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.260648 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.260962 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.261280 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.261619 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.261937 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.262264 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.262588 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.262948 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.263252 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.263561 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.263865 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.264167 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.264474 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.264778 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.265079 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.265381 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.265790 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.265935 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.266075 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.266376 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.266693 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.267001 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.267251 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.267349 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.267606 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.267701 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.267965 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.268058 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.268321 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.268581 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.268666 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.268971 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.269173 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.269302 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.269623 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.269759 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.269941 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.270261 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.270345 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.270578 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.270881 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.270982 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.271220 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.271470 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.271566 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.271836 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.272111 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.272198 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.272440 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.272651 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.272745 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.273055 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.273230 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.273365 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.273684 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.273796 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.273990 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.274318 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.274425 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.274629 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.274876 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.274977 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.275263 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.275420 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.275572 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.275919 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.276080 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.276226 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.276567 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.276659 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.276894 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.277110 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.277237 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.277546 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.277678 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.277852 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.278179 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.278264 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.278490 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.278794 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.278902 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.279114 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.279336 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.279435 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.279722 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.279910 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.280028 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.280302 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.280388 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.280633 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.280732 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.280942 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.281026 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.281806 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.282303 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.282392 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.282485 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.282566 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.282631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.282726 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.282835 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.283014 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.283157 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.283325 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.283470 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.283630 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.283781 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.283935 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.284099 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.284248 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.284415 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.284558 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.284725 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.284862 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.285040 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.285179 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.285349 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.285484 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.285668 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.285800 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.285975 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.286105 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.286280 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.286408 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.286587 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.286733 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.286925 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.287043 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.287236 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.287352 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.287542 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.287710 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.287865 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.287952 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.288176 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.288260 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.288483 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.288577 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.288788 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.288874 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.289099 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.289225 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.289404 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.289492 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.289709 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.289794 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.290016 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.290100 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.290336 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.290431 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.290651 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.290762 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.290976 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.291062 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.291283 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.291370 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.291588 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.291673 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.291891 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.291984 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.292193 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.292277 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.292497 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.292581 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.292800 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.292892 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.293102 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.293187 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.293404 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.293487 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.293705 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.293797 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.294012 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.294139 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.294339 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.294440 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.294638 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.294755 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.294968 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.295059 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.295279 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.295368 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.295578 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.295680 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.295921 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.296014 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.296223 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.296319 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.296577 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.296678 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.297461 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.297553 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.297832 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.297941 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.298160 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.298251 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.298478 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.298574 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.298813 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.298917 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.299131 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.299239 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.299436 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.299533 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.299752 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.299861 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.300067 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.300236 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.300375 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.300464 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.300677 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.300774 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.300979 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.301072 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.301296 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.301432 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.302698 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.302816 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.302816 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.302941 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303006 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303069 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303131 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303203 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303269 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303341 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303406 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303469 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303532 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303604 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303754 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.303842 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.304565 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.304660 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.304660 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.304803 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.304867 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.304931 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.304994 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.305057 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.305262 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.305357 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.305572 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.305665 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.306235 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.306317 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.306486 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396541 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396701 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.396799 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397410 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.397998 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398084 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398170 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398260 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398345 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398429 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398513 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398597 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398707 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398808 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398895 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.398978 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399061 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399144 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399233 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399312 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399398 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399481 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399559 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399665 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399665 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399835 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.399915 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400001 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400084 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400168 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400259 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400343 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400426 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400503 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400585 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400667 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400801 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400897 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.400990 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401078 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401156 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401248 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401333 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401411 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401494 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401576 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401654 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401742 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401820 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401896 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.401982 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.402066 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.402152 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.402363 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.402460 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.402545 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.402629 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408140 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408262 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408367 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408462 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408550 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408635 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408720 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408810 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.408895 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409003 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409095 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409185 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409275 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409360 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409446 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409537 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409617 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409695 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409779 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409867 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.409954 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410049 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410139 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410224 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410308 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410392 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410476 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410562 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410641 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410743 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410833 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.410913 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411001 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411090 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411180 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411180 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411347 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411426 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411511 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411590 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411674 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411777 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411867 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.411946 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412034 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412120 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412204 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412290 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412378 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412462 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412549 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412633 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412718 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412803 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412888 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.412973 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413068 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413154 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413243 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413327 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413411 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413572 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413659 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413744 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413828 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413920 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.413999 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414083 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414168 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414252 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414329 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414411 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414494 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414583 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414700 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414793 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414793 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.414942 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415020 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415108 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415194 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415281 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415366 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415443 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415528 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415614 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415693 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415776 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415860 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.415860 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416019 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416098 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416174 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416251 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416326 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416326 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416484 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416563 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416640 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416726 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416811 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416894 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416985 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.416985 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417139 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417139 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417291 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417381 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417461 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417541 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417625 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417703 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417786 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417879 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.417965 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418053 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418053 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418205 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418288 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418376 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418461 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418539 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418618 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418712 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418790 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418884 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.418964 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419041 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419123 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419208 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419297 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419381 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419458 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419534 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419610 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419694 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419785 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419865 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.419948 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420033 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420116 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420192 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420280 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420359 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420443 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420521 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420610 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420690 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420780 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420859 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.420935 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421017 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421101 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421188 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421266 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421348 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421426 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421562 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421644 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.421735 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.422389 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.422543 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.422716 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.422868 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423033 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423151 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423232 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423309 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423386 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423465 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423541 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423632 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423712 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423795 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423795 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.423942 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424029 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424122 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424201 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424295 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424378 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424455 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424543 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424627 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424716 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424793 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424879 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.424963 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425050 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425128 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425210 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425294 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425372 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425506 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425506 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425672 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425757 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425876 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.425962 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426052 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426132 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426214 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426299 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426299 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426299 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426511 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426596 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426738 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426823 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426910 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.426910 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427064 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427148 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427225 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427225 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427374 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427464 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427543 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427627 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427705 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427705 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427848 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.427935 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428012 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428089 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428165 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428241 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428333 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428420 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428498 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428498 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428684 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428770 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428859 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.428945 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429024 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429107 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429185 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429261 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429347 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429426 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429503 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429579 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429579 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429848 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.429939 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430018 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430094 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430179 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430179 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430335 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430414 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430497 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430582 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430677 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430776 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430857 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.430936 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431001 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431087 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431166 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431251 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431251 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431400 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431476 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431559 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431679 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431778 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431866 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.431954 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432041 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432119 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432119 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432267 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432346 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432422 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432510 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432589 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432674 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432758 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432836 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432912 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.432995 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433073 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433162 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433242 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433319 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433395 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433478 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433562 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433654 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433739 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433817 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433901 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.433989 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434068 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434153 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434231 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434308 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434384 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434460 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434547 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434633 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434766 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434845 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434921 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.434997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435086 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435173 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435259 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435344 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435423 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435507 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435594 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435673 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435749 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435824 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.435959 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436052 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436052 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436216 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436295 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436372 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436448 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436611 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436687 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436762 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436838 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.436926 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437021 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437100 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437176 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437258 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437337 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437414 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437573 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437696 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437835 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.437986 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438303 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438396 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438474 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438552 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438628 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438628 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438807 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438888 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438965 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.438965 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.439358 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.439436 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.439521 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.439610 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.439689 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.439807 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.439893 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.440022 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.440123 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.440331 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.440419 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.440639 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.440727 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.440948 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.441046 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.441299 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.441394 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.441616 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.441713 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.441920 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.442007 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.442232 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.442318 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.442541 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.442627 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.442881 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.443123 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.443218 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.443461 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.443555 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.443778 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.443877 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.444091 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.444178 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.444431 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.444518 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.444742 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.444841 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.445049 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.445134 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.445356 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.445453 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.445671 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.445757 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.445978 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.446064 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.446289 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.446374 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.446598 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.446714 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.446948 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.447044 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.447257 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.447342 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.447569 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.447657 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.447880 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.447966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.448191 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.448285 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.448502 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.448742 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.448835 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.449081 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.449167 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.449404 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.449497 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.449714 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.449800 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.450024 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.450120 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.450338 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.450425 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.450647 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.450754 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.450977 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.451152 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.451313 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.451407 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.451629 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.451723 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.451941 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.452045 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.452247 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.452340 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.452554 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.452647 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.452862 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.452955 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.453704 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.453844 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.454114 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.454265 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.454449 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.454587 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.454792 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.454998 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.455109 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.455307 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.455407 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.455719 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.456015 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.456108 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.456330 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.456415 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.456651 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.456745 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.456978 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.457065 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.457291 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.457378 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.457609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.457703 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.457927 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.458014 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.458239 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.458334 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.458549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.458634 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.458883 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.459011 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.459191 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.459331 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.459503 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.459632 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.459819 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.459947 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.460149 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.460323 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.460464 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.460591 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.460726 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.460851 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.461034 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.461342 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.461472 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.461658 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.461788 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.461967 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.462104 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.462272 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.462400 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.462575 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.462728 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.462908 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.463048 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.463214 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.463352 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.463518 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.463645 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.463822 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.463957 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.464125 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.464253 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.464433 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.464561 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.464735 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.464874 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.465039 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.465167 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.465347 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.465482 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.465649 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.465784 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.465949 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.466077 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.466250 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.466376 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.466558 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.466709 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.466900 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.467030 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.467206 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.467347 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.467511 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.467638 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.467816 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.467944 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.468117 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.468258 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.468417 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.468543 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.469334 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.469555 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.469769 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.469998 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.470137 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.470263 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.470386 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.470510 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.470635 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.470829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.470956 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.471090 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.471215 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.471380 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.471526 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.471701 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.471829 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.472019 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.472149 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.472329 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.472467 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.472659 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.472785 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.472966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.473093 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.473271 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.473407 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.473584 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.473711 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.473886 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.474019 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.474191 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.474328 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.474499 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.474628 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.474853 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.474993 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.475171 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.475299 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.475478 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.475621 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.475796 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.475922 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.476109 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.476251 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.476426 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.476559 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.476742 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.476869 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.477053 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.477189 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.477361 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.477488 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.477676 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.477817 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.477987 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.478121 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.478295 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.478431 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.478605 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.478805 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.478932 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.479063 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.479244 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.479381 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.479557 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.479697 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.479869 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.479997 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.480187 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.480314 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.480503 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.480640 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.480827 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.480954 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.481145 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.481279 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.481500 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.481627 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.481752 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.481883 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.482065 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.482185 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.482394 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.482523 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.482739 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.482872 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.483043 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.483173 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.483352 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.483481 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.483662 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.483791 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.483972 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.484113 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.484296 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.484423 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.484640 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.484848 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 23:51:56.485057 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.485253 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.485572 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.485897 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.486222 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.486532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.486883 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.487212 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.487558 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.487872 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.488214 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.488543 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.488858 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.489171 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.489476 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 23:51:56.489718 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 23:51:56.636722 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO dbcounter [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Registered counter for database nova_api Sep 10 23:51:56.642914 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO dbcounter [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Registered counter for database nova_api Sep 10 23:51:56.658285 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_db.sqlalchemy.engines [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 23:51:56.664573 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_db.sqlalchemy.engines [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 23:51:56.664740 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writer thread running {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 23:51:56.671064 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writer thread running {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 23:51:56.721444 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.context [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f4b48d3-0a1e-4042-b9a7-615220ba0b82(cell1) {{(pid=105832) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 23:51:56.725351 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:51:56.725826 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:51:56.727486 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:51:56.728220 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:51:56.728665 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:51:56.730626 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:51:56.732651 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO dbcounter [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Registered counter for database nova_cell0 Sep 10 23:51:56.733001 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.context [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f4b48d3-0a1e-4042-b9a7-615220ba0b82(cell1) {{(pid=105831) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 23:51:56.737340 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO dbcounter [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Registered counter for database nova_cell1 Sep 10 23:51:56.737688 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_concurrency.lockutils [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:51:56.738171 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_concurrency.lockutils [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:51:56.739870 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_concurrency.lockutils [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:51:56.740617 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_concurrency.lockutils [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:51:56.741066 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_concurrency.lockutils [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:51:56.743111 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_concurrency.lockutils [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:51:56.744870 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_db.sqlalchemy.engines [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 23:51:56.745173 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO dbcounter [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Registered counter for database nova_cell0 Sep 10 23:51:56.746511 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_db.sqlalchemy.engines [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 23:51:56.749290 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO dbcounter [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Registered counter for database nova_cell1 Sep 10 23:51:56.753336 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writer thread running {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 23:51:56.754817 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writer thread running {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 23:51:56.756982 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_db.sqlalchemy.engines [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 23:51:56.758706 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_db.sqlalchemy.engines [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 23:51:56.764863 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writer thread running {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 23:51:56.766357 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writer thread running {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 23:51:56.898297 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO dbcounter [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Registered counter for database nova_cell0 Sep 10 23:51:56.905533 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_db.sqlalchemy.engines [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 23:51:56.910505 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writer thread running {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 23:51:56.912325 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO dbcounter [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Registered counter for database nova_cell0 Sep 10 23:51:56.920972 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG oslo_db.sqlalchemy.engines [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 23:51:56.926440 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writer thread running {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 23:51:57.335962 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: WARNING keystonemiddleware.auth_token [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 23:51:57.343594 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: WARNING keystonemiddleware.auth_token [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 23:51:57.363876 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: WARNING keystonemiddleware.auth_token [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 23:51:57.371277 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: WARNING keystonemiddleware.auth_token [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 23:51:57.685551 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: WARNING keystonemiddleware.auth_token [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 23:51:57.692229 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: WARNING keystonemiddleware.auth_token [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 23:51:57.698094 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5622ec9499c0 pid: 105832 (default app) Sep 10 23:51:57.700193 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:51:57.701356 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Sep 10 23:51:57.701764 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Sat Sep 10 23:51:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:51:57.740481 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: WARNING keystonemiddleware.auth_token [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 23:51:57.746441 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: WARNING keystonemiddleware.auth_token [None req-4edff0d4-b9c7-46ca-a047-8dea87cd040e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 23:51:57.752332 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5622ec9499c0 pid: 105831 (default app) Sep 10 23:53:22.954908 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:22.956809 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002434 Sep 10 23:53:22.958289 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:22.976424 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writing DB stats nova_api:SELECT=3 {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:22.977443 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writing DB stats nova_cell0:SELECT=3 {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:22.978229 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writing DB stats nova_cell1:SELECT=3 {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:22.979243 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:23.832142 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-e421ad12-5d0e-4e18-9030-1e4264aec363 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:23.865343 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-e421ad12-5d0e-4e18-9030-1e4264aec363 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.899635 Sep 10 23:53:23.866081 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Sep 10 23:53:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:53:26.500481 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:26.502088 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-99cc0513-847b-4078-a1c6-fcdd6d70a89d None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002337 Sep 10 23:53:26.502512 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:26.951114 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-f9bdb8f1-5bc8-4296-bad6-03f15f6b0d73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "name": "cirros256", "vcpus": 1}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:27.049328 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-f9bdb8f1-5bc8-4296-bad6-03f15f6b0d73 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.540134 Sep 10 23:53:27.049895 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 23:53:27.064313 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:SELECT=3 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:27.065383 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_cell0:SELECT=3 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:27.067356 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_cell1:SELECT=3 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:27.068108 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:27.278170 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-8881a8f3-526a-48bc-ae71-d745843b4786 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:27.420764 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-8881a8f3-526a-48bc-ae71-d745843b4786 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360927 Sep 10 23:53:27.420764 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Sep 10 23:53:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:53:30.019535 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-f9bdb8f1-5bc8-4296-bad6-03f15f6b0d73 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:30.020553 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-f9bdb8f1-5bc8-4296-bad6-03f15f6b0d73 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Sep 10 23:53:30.021136 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:30.685074 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-b05bd79b-b8aa-478b-b890-42e19d695cea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:30.805668 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-b05bd79b-b8aa-478b-b890-42e19d695cea admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777674 Sep 10 23:53:30.806527 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:53:30.818556 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-c453d3be-310b-40d6-b5d2-c87176b4a224 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:30.923121 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-c453d3be-310b-40d6-b5d2-c87176b4a224 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108383 Sep 10 23:53:30.923961 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Sep 10 23:53:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 23:53:33.541814 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-b05bd79b-b8aa-478b-b890-42e19d695cea admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:33.542884 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-b05bd79b-b8aa-478b-b890-42e19d695cea admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 10 23:53:33.543412 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:33.970253 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-4af0c849-d54c-4f07-a40a-a6f7b9ce3cb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "ds1G"}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:34.038326 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-4af0c849-d54c-4f07-a40a-a6f7b9ce3cb6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488409 Sep 10 23:53:34.038931 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:53:34.051613 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-d08457e3-21c4-4aad-b967-d657a75b96b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:34.134935 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-d08457e3-21c4-4aad-b967-d657a75b96b8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086970 Sep 10 23:53:34.136775 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Sep 10 23:53:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:53:36.797744 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-4af0c849-d54c-4f07-a40a-a6f7b9ce3cb6 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:36.799169 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-4af0c849-d54c-4f07-a40a-a6f7b9ce3cb6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002800 Sep 10 23:53:36.799582 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:37.204018 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-d09ca90a-c192-48fb-a8ba-9fd6fec5031f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:37.278792 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-d09ca90a-c192-48fb-a8ba-9fd6fec5031f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472742 Sep 10 23:53:37.279838 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 23:53:37.292261 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-640666da-b981-4148-87f1-30bb4718dc90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:37.379919 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-640666da-b981-4148-87f1-30bb4718dc90 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091235 Sep 10 23:53:37.380734 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Sep 10 23:53:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:53:40.037579 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-d09ca90a-c192-48fb-a8ba-9fd6fec5031f admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:40.038923 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-d09ca90a-c192-48fb-a8ba-9fd6fec5031f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Sep 10 23:53:40.039460 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:40.494563 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-54a9d223-73cb-4923-bd16-beae69af2b10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "id": "d4", "swap": 0}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:40.593609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-54a9d223-73cb-4923-bd16-beae69af2b10 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.545881 Sep 10 23:53:40.594229 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:53:40.608343 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-ff6506b2-39cb-4459-8dd6-0e9df5abecd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:40.676802 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-ff6506b2-39cb-4459-8dd6-0e9df5abecd3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072119 Sep 10 23:53:40.677371 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Sep 10 23:53:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:53:43.512478 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-54a9d223-73cb-4923-bd16-beae69af2b10 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:43.513851 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-54a9d223-73cb-4923-bd16-beae69af2b10 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Sep 10 23:53:43.514409 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 23:53:43.957013 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-0622cb0e-06a6-4943-b996-f739c7145be8 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:43.995643 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-0622cb0e-06a6-4943-b996-f739c7145be8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.474164 Sep 10 23:53:43.996451 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Sep 10 23:53:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:53:47.024674 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-54a9d223-73cb-4923-bd16-beae69af2b10 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:47.025688 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-54a9d223-73cb-4923-bd16-beae69af2b10 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 10 23:53:47.026100 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:47.559581 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-97ad468e-9c2c-483d-b0de-b16f86d12f77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:47.627713 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-97ad468e-9c2c-483d-b0de-b16f86d12f77 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.594724 Sep 10 23:53:47.628272 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:53:47.640495 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-639c72aa-aff3-4dc2-bfef-5ec1656d6825 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:47.716090 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-639c72aa-aff3-4dc2-bfef-5ec1656d6825 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079360 Sep 10 23:53:47.716688 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Sep 10 23:53:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 23:53:50.315638 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-97ad468e-9c2c-483d-b0de-b16f86d12f77 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:50.316657 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-97ad468e-9c2c-483d-b0de-b16f86d12f77 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 Sep 10 23:53:50.317061 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:50.722280 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-33e50325-7f29-4e08-8cd1-aaee2e7850e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:50.817299 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-33e50325-7f29-4e08-8cd1-aaee2e7850e6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.494234 Sep 10 23:53:50.818116 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 23:53:50.830804 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-81696fe8-05ef-482a-9924-3b1facb93296 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:50.933890 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-81696fe8-05ef-482a-9924-3b1facb93296 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106526 Sep 10 23:53:50.934605 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Sep 10 23:53:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:53:53.633026 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-33e50325-7f29-4e08-8cd1-aaee2e7850e6 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:53.634729 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-33e50325-7f29-4e08-8cd1-aaee2e7850e6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 Sep 10 23:53:53.635411 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:54.067634 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-944bb0b4-5f55-44a5-98bf-23af549818cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:54.164740 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-944bb0b4-5f55-44a5-98bf-23af549818cd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.522382 Sep 10 23:53:54.165370 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:53:54.178644 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-5e3cc031-0dc5-41dc-a0cf-8a46a4e64179 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:54.184547 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:54.287324 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-5e3cc031-0dc5-41dc-a0cf-8a46a4e64179 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112484 Sep 10 23:53:54.288629 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Sep 10 23:53:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:53:56.941552 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-944bb0b4-5f55-44a5-98bf-23af549818cd admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:53:56.942565 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-944bb0b4-5f55-44a5-98bf-23af549818cd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 10 23:53:56.943007 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:53:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:53:57.385266 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-5ea8a384-1c2b-4048-b2e1-effb2ad1052b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:57.468066 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-5ea8a384-1c2b-4048-b2e1-effb2ad1052b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.517773 Sep 10 23:53:57.468066 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:53:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:53:57.479949 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-6b62db24-b885-4bed-a77d-cb6ae7e83bfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:53:57.485944 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:53:57.602211 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-6b62db24-b885-4bed-a77d-cb6ae7e83bfb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125849 Sep 10 23:53:57.611760 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Sep 10 23:53:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:54:00.309678 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-5ea8a384-1c2b-4048-b2e1-effb2ad1052b admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:00.310713 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-5ea8a384-1c2b-4048-b2e1-effb2ad1052b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 10 23:54:00.314973 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:54:00 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:54:00.762307 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7acac632-2417-4b6e-9978-a3e4a6642ba5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "swap": 0}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:54:00.855377 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-7acac632-2417-4b6e-9978-a3e4a6642ba5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.537260 Sep 10 23:54:00.856179 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Sep 10 23:54:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:54:00.871388 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-e3c5175d-19ab-441e-92d1-7c37b0a34acb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:54:00.961806 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-e3c5175d-19ab-441e-92d1-7c37b0a34acb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094249 Sep 10 23:54:00.962614 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Sep 10 23:54:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:54:17.944291 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7acac632-2417-4b6e-9978-a3e4a6642ba5 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:17.945328 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-7acac632-2417-4b6e-9978-a3e4a6642ba5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 10 23:54:17.945734 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:54:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:54:17.956318 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:54:18.453014 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-6e646275-92f7-469c-a5ae-e5162a233d78 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:18.471706 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-6e646275-92f7-469c-a5ae-e5162a233d78 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.519820 Sep 10 23:54:18.472475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Sep 10 23:54:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:54:19.790094 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7acac632-2417-4b6e-9978-a3e4a6642ba5 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:19.791173 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-7acac632-2417-4b6e-9978-a3e4a6642ba5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 10 23:54:19.791573 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:54:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:54:20.311395 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-2fe7b98a-7acd-41d0-a6c3-25512886d9d9 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:20.317780 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.wsgi [None req-2fe7b98a-7acd-41d0-a6c3-25512886d9d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-2fe7b98a-7acd-41d0-a6c3-25512886d9d9 admin admin] Request method failure captured: Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Accept: application/json Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Accept-Encoding: gzip, deflate Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Connection: keep-alive Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Content-Length: 0 Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Host: 10.222.0.17 Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Openstack-Api-Version: compute 2.92 Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Openstack-System-Scope: None Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: User-Agent: python-novaclient Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Auth-Token: gAAAAABjHSOreeS49Gv8roZh0TZBiE7k1Dglqzz3G0CX4Vkn3Z60hiO5JRbAToMijMyrtSdsKPep_6fjpA1UsJgOj13dW1aDkzqVDZAP1mJiyNnx6PCdzWCUgJa8ismthO7ExqNMdWY23WMYfz9ilyqnnWG5jDSKe904LjuKdStqay_KHj-DRh8 Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Domain-Id: None Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Domain-Name: None Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Identity-Status: Confirmed Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Is-Admin-Project: True Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Domain-Id: default Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Domain-Name: Default Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Name: admin Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Role: member,admin,reader Sep 10 23:54:20.320966 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Roles: member,admin,reader Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab88f917c063407982ac832bef946248", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab88f917c063407982ac832bef946248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}] Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant: admin Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant-Name: admin Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User: admin Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Domain-Id: default Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Domain-Name: Default Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Id: 5243f89b8bf44f868ec5406d662b5cd9 Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Name: admin Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: method: > Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: exception: Flavor 42 could not be found. Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: action_args: {'id': '42'} Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 23:54:20.322549 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:20.323609 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.325028 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-2fe7b98a-7acd-41d0-a6c3-25512886d9d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 23:54:20.326239 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-2fe7b98a-7acd-41d0-a6c3-25512886d9d9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389547 Sep 10 23:54:20.326239 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Sep 10 23:54:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 23:54:20.332155 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7cd338dc-5bd2-4e5d-9a6e-e29496fa5034 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:20.336262 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:54:20.354641 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-7cd338dc-5bd2-4e5d-9a6e-e29496fa5034 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026150 Sep 10 23:54:20.355201 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Sep 10 23:54:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:54:20.366349 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-14c3765a-2f2a-47b6-964f-d52b21ecf9e0 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:20.388011 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-14c3765a-2f2a-47b6-964f-d52b21ecf9e0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026658 Sep 10 23:54:20.388539 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Sep 10 23:54:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 23:54:20.398894 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-2f13ff75-3bb8-4957-8d49-733ec7b2e863 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:20.404275 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.wsgi [None req-2f13ff75-3bb8-4957-8d49-733ec7b2e863 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-2f13ff75-3bb8-4957-8d49-733ec7b2e863 admin admin] Request method failure captured: Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Accept: application/json Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Accept-Encoding: gzip, deflate Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Connection: keep-alive Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Content-Length: 0 Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Host: 10.222.0.17 Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Openstack-Api-Version: compute 2.92 Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Openstack-System-Scope: None Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: User-Agent: python-novaclient Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Auth-Token: gAAAAABjHSOreeS49Gv8roZh0TZBiE7k1Dglqzz3G0CX4Vkn3Z60hiO5JRbAToMijMyrtSdsKPep_6fjpA1UsJgOj13dW1aDkzqVDZAP1mJiyNnx6PCdzWCUgJa8ismthO7ExqNMdWY23WMYfz9ilyqnnWG5jDSKe904LjuKdStqay_KHj-DRh8 Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Domain-Id: None Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Domain-Name: None Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Identity-Status: Confirmed Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Is-Admin-Project: True Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Domain-Id: default Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Domain-Name: Default Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Name: admin Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Role: member,admin,reader Sep 10 23:54:20.407819 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Roles: member,admin,reader Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab88f917c063407982ac832bef946248", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab88f917c063407982ac832bef946248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}] Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant: admin Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant-Name: admin Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User: admin Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Domain-Id: default Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Domain-Name: Default Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Id: 5243f89b8bf44f868ec5406d662b5cd9 Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Name: admin Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: method: > Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: exception: Flavor 42 could not be found. Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: action_args: {'id': '42'} Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 23:54:20.410011 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:20.413758 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:20.415077 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-2f13ff75-3bb8-4957-8d49-733ec7b2e863 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 23:54:20.416283 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-2f13ff75-3bb8-4957-8d49-733ec7b2e863 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015083 Sep 10 23:54:20.416283 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Sep 10 23:54:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 23:54:21.618120 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-14c3765a-2f2a-47b6-964f-d52b21ecf9e0 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:21.619158 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-14c3765a-2f2a-47b6-964f-d52b21ecf9e0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Sep 10 23:54:21.619551 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:54:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:54:22.150354 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-c07145a5-4864-4175-858c-e111bcaf8fe5 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:22.155378 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.wsgi [None req-c07145a5-4864-4175-858c-e111bcaf8fe5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-c07145a5-4864-4175-858c-e111bcaf8fe5 admin admin] Request method failure captured: Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Accept: application/json Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Accept-Encoding: gzip, deflate Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Connection: keep-alive Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Content-Length: 0 Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Host: 10.222.0.17 Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Openstack-Api-Version: compute 2.92 Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Openstack-System-Scope: None Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: User-Agent: python-novaclient Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Auth-Token: gAAAAABjHSOtPFQNPllDJOnoZP7_WYrsmJZmiPGkjOkL5d0YhJ7eMCIWdlZbi6_CdP3impjZRLeOwr1FDSI0VCHOTvlWmwtyxixRRVZdxMsAZRDQ4bdn9egiXizgBVPe16abf9sttq9XvyxT-brMEJcr2YhMjwdMNxlPbAVS1srumRZtr-ag22U Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Domain-Id: None Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Domain-Name: None Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Identity-Status: Confirmed Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Is-Admin-Project: True Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Domain-Id: default Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Domain-Name: Default Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Name: admin Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Role: member,admin,reader Sep 10 23:54:22.156953 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Roles: member,admin,reader Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab88f917c063407982ac832bef946248", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab88f917c063407982ac832bef946248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}] Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant: admin Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant-Name: admin Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User: admin Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Domain-Id: default Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Domain-Name: Default Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Id: 5243f89b8bf44f868ec5406d662b5cd9 Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Name: admin Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: method: > Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: exception: Flavor 84 could not be found. Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: action_args: {'id': '84'} Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 23:54:22.159265 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:22.160221 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.161680 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-c07145a5-4864-4175-858c-e111bcaf8fe5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 23:54:22.162910 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-c07145a5-4864-4175-858c-e111bcaf8fe5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.400540 Sep 10 23:54:22.162910 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Sep 10 23:54:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 23:54:22.169961 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-51ff3116-c8ff-4e7c-8c41-3666a142a12e admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:22.185456 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-51ff3116-c8ff-4e7c-8c41-3666a142a12e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019013 Sep 10 23:54:22.185982 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Sep 10 23:54:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:54:22.196376 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-0ca3ae3b-af30-4c96-8f37-34a8b819c1b0 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:22.212524 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-0ca3ae3b-af30-4c96-8f37-34a8b819c1b0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019684 Sep 10 23:54:22.213046 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Sep 10 23:54:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:54:22.222419 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-16c2f817-a5d9-45c5-b664-76c03579864b admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:22.227576 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.wsgi [None req-16c2f817-a5d9-45c5-b664-76c03579864b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-16c2f817-a5d9-45c5-b664-76c03579864b admin admin] Request method failure captured: Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Accept: application/json Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Accept-Encoding: gzip, deflate Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Connection: keep-alive Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Content-Length: 0 Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Host: 10.222.0.17 Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Openstack-Api-Version: compute 2.92 Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Openstack-System-Scope: None Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: User-Agent: python-novaclient Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Auth-Token: gAAAAABjHSOtPFQNPllDJOnoZP7_WYrsmJZmiPGkjOkL5d0YhJ7eMCIWdlZbi6_CdP3impjZRLeOwr1FDSI0VCHOTvlWmwtyxixRRVZdxMsAZRDQ4bdn9egiXizgBVPe16abf9sttq9XvyxT-brMEJcr2YhMjwdMNxlPbAVS1srumRZtr-ag22U Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Domain-Id: None Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Domain-Name: None Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Identity-Status: Confirmed Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Is-Admin-Project: True Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Domain-Id: default Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Domain-Name: Default Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Name: admin Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Role: member,admin,reader Sep 10 23:54:22.229060 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Roles: member,admin,reader Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab88f917c063407982ac832bef946248", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab88f917c063407982ac832bef946248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}] Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant: admin Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant-Name: admin Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User: admin Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Domain-Id: default Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Domain-Name: Default Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Id: 5243f89b8bf44f868ec5406d662b5cd9 Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Name: admin Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: method: > Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: exception: Flavor 84 could not be found. Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: action_args: {'id': '84'} Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 23:54:22.230507 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:22.231475 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:22.232812 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-16c2f817-a5d9-45c5-b664-76c03579864b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 23:54:22.234015 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-16c2f817-a5d9-45c5-b664-76c03579864b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011786 Sep 10 23:54:22.234015 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Sep 10 23:54:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 23:54:23.457679 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-0ca3ae3b-af30-4c96-8f37-34a8b819c1b0 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:23.458725 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-0ca3ae3b-af30-4c96-8f37-34a8b819c1b0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 10 23:54:23.459125 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:54:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:54:23.985602 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-06a3c2b7-1d40-4956-8f96-06f827fac935 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:23.991649 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.wsgi [None req-06a3c2b7-1d40-4956-8f96-06f827fac935 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-06a3c2b7-1d40-4956-8f96-06f827fac935 admin admin] Request method failure captured: Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Accept: application/json Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Accept-Encoding: gzip, deflate Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Connection: keep-alive Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Content-Length: 0 Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Host: 10.222.0.17 Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Openstack-Api-Version: compute 2.92 Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Openstack-System-Scope: None Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: User-Agent: python-novaclient Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Auth-Token: gAAAAABjHSOvTgB--UjJjH96h-ENe8WaR-DhrMcSAH9_D04-RS2tn8MzTkroj-Ov35IlbuWOkjKwLWdA5L5_WK2DzFTaLL6idSihgh7edeMAGRZhHA-nfrolVkM7tCB8P9U9k2Kg_EoKz4TtBllDmEGZNg7L_v3vfNB-eHYiAeCi-g1Z6Mwu6WM Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Domain-Id: None Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Domain-Name: None Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Identity-Status: Confirmed Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Is-Admin-Project: True Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Domain-Id: default Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Domain-Name: Default Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Project-Name: admin Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Role: member,admin,reader Sep 10 23:54:23.993138 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Roles: member,admin,reader Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab88f917c063407982ac832bef946248", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab88f917c063407982ac832bef946248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}] Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant: admin Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-Tenant-Name: admin Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User: admin Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Domain-Id: default Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Domain-Name: Default Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Id: 5243f89b8bf44f868ec5406d662b5cd9 Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: X-User-Name: admin Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: method: > Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: exception: Flavor 451 could not be found. Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: action_args: {'id': '451'} Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 23:54:23.994631 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:23.995532 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: ERROR nova.api.openstack.wsgi Sep 10 23:54:23.996754 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-06a3c2b7-1d40-4956-8f96-06f827fac935 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 23:54:23.997989 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-06a3c2b7-1d40-4956-8f96-06f827fac935 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395993 Sep 10 23:54:23.997989 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Sep 10 23:54:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 23:54:24.005058 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-d9e30d78-4b71-4d49-98b9-b9b64755b121 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:24.020474 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-d9e30d78-4b71-4d49-98b9-b9b64755b121 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019726 Sep 10 23:54:24.020994 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Sep 10 23:54:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:54:24.030191 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:24.045230 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018523 Sep 10 23:54:24.045758 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Sep 10 23:54:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:54:24.056127 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9e69635c-6eb0-4eb3-8eb0-cee767b8532e admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:24.061286 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.wsgi [None req-9e69635c-6eb0-4eb3-8eb0-cee767b8532e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9e69635c-6eb0-4eb3-8eb0-cee767b8532e admin admin] Request method failure captured: Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Accept: application/json Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Accept-Encoding: gzip, deflate Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Connection: keep-alive Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Content-Length: 0 Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Host: 10.222.0.17 Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Openstack-Api-Version: compute 2.92 Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Openstack-System-Scope: None Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: User-Agent: python-novaclient Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Auth-Token: gAAAAABjHSOvTgB--UjJjH96h-ENe8WaR-DhrMcSAH9_D04-RS2tn8MzTkroj-Ov35IlbuWOkjKwLWdA5L5_WK2DzFTaLL6idSihgh7edeMAGRZhHA-nfrolVkM7tCB8P9U9k2Kg_EoKz4TtBllDmEGZNg7L_v3vfNB-eHYiAeCi-g1Z6Mwu6WM Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Domain-Id: None Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Domain-Name: None Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Identity-Status: Confirmed Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Is-Admin-Project: True Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Domain-Id: default Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Domain-Name: Default Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Project-Name: admin Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Role: member,admin,reader Sep 10 23:54:24.062829 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Roles: member,admin,reader Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab88f917c063407982ac832bef946248", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab88f917c063407982ac832bef946248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab88f917c063407982ac832bef946248"}]}] Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant: admin Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant-Id: ab88f917c063407982ac832bef946248 Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-Tenant-Name: admin Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User: admin Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Domain-Id: default Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Domain-Name: Default Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Id: 5243f89b8bf44f868ec5406d662b5cd9 Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: X-User-Name: admin Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: method: > Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: exception: Flavor 451 could not be found. Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: action_args: {'id': '451'} Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 23:54:24.064290 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:24.065372 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 10 23:54:24.066997 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9e69635c-6eb0-4eb3-8eb0-cee767b8532e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 23:54:24.068280 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9e69635c-6eb0-4eb3-8eb0-cee767b8532e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011598 Sep 10 23:54:24.068280 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Sep 10 23:54:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 23:54:25.309006 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:25.310005 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 10 23:54:25.310414 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:54:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:54:25.838602 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-ee0d352c-45d0-4f9f-960c-4de5c3969ce1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:54:25.946268 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-ee0d352c-45d0-4f9f-960c-4de5c3969ce1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.500076 Sep 10 23:54:25.946867 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Sep 10 23:54:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:54:27.153114 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:27.154157 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 10 23:54:27.154569 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:54:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:54:27.672603 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-d6c88eaf-f2b0-4ae3-8703-7c056db95fa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:54:27.745326 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-d6c88eaf-f2b0-4ae3-8703-7c056db95fa9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.450843 Sep 10 23:54:27.745863 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Sep 10 23:54:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 23:54:28.972737 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:28.973736 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 10 23:54:28.974132 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:54:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 23:54:29.492353 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-e0db76a9-584a-4a04-8e69-127a8c8fd287 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:54:29.558018 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-e0db76a9-584a-4a04-8e69-127a8c8fd287 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.446717 Sep 10 23:54:29.558556 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Sep 10 23:54:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:54:30.778348 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:30.779377 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 10 23:54:30.779775 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:54:31.294633 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-04d211f2-949c-4f97-927b-75de0dd0dc29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 23:54:31.373182 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-04d211f2-949c-4f97-927b-75de0dd0dc29 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.456385 Sep 10 23:54:31.373769 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Sep 10 23:54:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:54:32.613083 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:32.614072 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 10 23:54:32.614469 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 23:54:33.137376 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7d70443c-0d10-4596-baf5-160467cace2f admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:54:33.157658 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-7d70443c-0d10-4596-baf5-160467cace2f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399597 Sep 10 23:54:33.158323 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Sep 10 23:54:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:55:30.350128 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:55:30.351165 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-d2bc8605-525b-4fb2-8483-dc34842d05be admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 10 23:55:30.351561 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Sat Sep 10 23:55:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:55:30.362695 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:55:30.744097 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-b2caa617-ccb8-4a93-970b-4630c829f3cf admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:55:30.764233 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-b2caa617-ccb8-4a93-970b-4630c829f3cf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406597 Sep 10 23:55:30.764760 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Sep 10 23:55:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:55:30.786352 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writing DB stats nova_api:SELECT=14 {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:55:30.790093 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-5eec4403-76bf-4812-8fa6-00eb42b28e15 admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:55:30.797411 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-5eec4403-76bf-4812-8fa6-00eb42b28e15 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012457 Sep 10 23:55:30.797939 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Sat Sep 10 23:55:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:55:30.809670 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-fe16dc11-6f6e-4dee-bf2b-7601c6f69cee admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:55:30.817367 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-fe16dc11-6f6e-4dee-bf2b-7601c6f69cee admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011392 Sep 10 23:55:30.817879 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Sat Sep 10 23:55:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:55:30.829677 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:55:30.837036 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011386 Sep 10 23:55:30.837557 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Sat Sep 10 23:55:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 23:55:30.849990 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-ee01c5ea-5e2e-4100-864b-9cedc16272fc admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:55:30.857059 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-ee01c5ea-5e2e-4100-864b-9cedc16272fc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011092 Sep 10 23:55:30.857572 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Sat Sep 10 23:55:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 23:58:58.012694 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:58:58.013751 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 10 23:58:58.014148 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:58:58.154010 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:SELECT=6 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:58:58.294307 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-99596de2-b4ff-4ea0-9b65-aca949d77276 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:58:58.299978 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99596de2-b4ff-4ea0-9b65-aca949d77276 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:58:58.300543 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99596de2-b4ff-4ea0-9b65-aca949d77276 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:58:58.300986 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99596de2-b4ff-4ea0-9b65-aca949d77276 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:58:58.301714 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99596de2-b4ff-4ea0-9b65-aca949d77276 admin admin] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:58:58.302174 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99596de2-b4ff-4ea0-9b65-aca949d77276 admin admin] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:58:58.302603 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-99596de2-b4ff-4ea0-9b65-aca949d77276 admin admin] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:58:58.334438 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-99596de2-b4ff-4ea0-9b65-aca949d77276 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.181514 Sep 10 23:58:58.335028 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Sep 10 23:58:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:58:59.417451 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:58:59.418463 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 10 23:58:59.418895 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:58:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:58:59.622944 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-d7d3eb66-1bb2-4518-aadc-f75774156b82 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:58:59.626727 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-d7d3eb66-1bb2-4518-aadc-f75774156b82 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:58:59.627216 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-d7d3eb66-1bb2-4518-aadc-f75774156b82 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:58:59.627653 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-d7d3eb66-1bb2-4518-aadc-f75774156b82 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:58:59.628374 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-d7d3eb66-1bb2-4518-aadc-f75774156b82 admin admin] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:58:59.628826 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-d7d3eb66-1bb2-4518-aadc-f75774156b82 admin admin] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:58:59.629252 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-d7d3eb66-1bb2-4518-aadc-f75774156b82 admin admin] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:58:59.648367 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-d7d3eb66-1bb2-4518-aadc-f75774156b82 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080834 Sep 10 23:58:59.648919 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Sep 10 23:58:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 23:59:11.147934 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:59:11.148948 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 10 23:59:11.149340 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:59:11.301559 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_cell0:SELECT=4 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:59:11.302284 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_cell1:SELECT=4 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:59:11.302926 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:SELECT=8 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 23:59:11.350858 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-71ca9083-6255-4829-9593-2740469b09e8 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:59:11.354270 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-71ca9083-6255-4829-9593-2740469b09e8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:59:11.354721 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-71ca9083-6255-4829-9593-2740469b09e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:59:11.355160 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-71ca9083-6255-4829-9593-2740469b09e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:59:11.355879 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-71ca9083-6255-4829-9593-2740469b09e8 admin admin] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:59:11.356323 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-71ca9083-6255-4829-9593-2740469b09e8 admin admin] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:59:11.356746 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-71ca9083-6255-4829-9593-2740469b09e8 admin admin] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:59:11.383441 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-71ca9083-6255-4829-9593-2740469b09e8 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086782 Sep 10 23:59:11.383996 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Sep 10 23:59:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 23:59:12.478498 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG nova.api.openstack.wsgi [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] Calling method '>' {{(pid=105831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:59:12.479565 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: INFO nova.api.openstack.requestlog [None req-b73da223-b7d4-4d28-8c3f-3828e36c666a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 10 23:59:12.479963 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: [pid: 105831|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Sep 10 23:59:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 23:59:12.671702 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9d4d1002-64c8-4960-967d-0a990ee2b2e6 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 23:59:12.675850 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-9d4d1002-64c8-4960-967d-0a990ee2b2e6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:59:12.676325 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-9d4d1002-64c8-4960-967d-0a990ee2b2e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:59:12.676761 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-9d4d1002-64c8-4960-967d-0a990ee2b2e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:59:12.677476 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-9d4d1002-64c8-4960-967d-0a990ee2b2e6 admin admin] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 23:59:12.677925 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-9d4d1002-64c8-4960-967d-0a990ee2b2e6 admin admin] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 23:59:12.678343 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-9d4d1002-64c8-4960-967d-0a990ee2b2e6 admin admin] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 23:59:12.700736 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9d4d1002-64c8-4960-967d-0a990ee2b2e6 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080557 Sep 10 23:59:12.701280 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Sep 10 23:59:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:00:10.107965 dv-cinder-852009-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 11 00:00:10.109197 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: Sun Sep 11 00:00:10 2022 - graceful shutdown triggered... Sep 11 00:00:10.110443 dv-cinder-852009-6-iscsi devstack@n-api.service[105832]: Gracefully killing worker 2 (pid: 105832)... Sep 11 00:00:10.110850 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: Gracefully killing worker 1 (pid: 105831)... Sep 11 00:00:10.233596 dv-cinder-852009-6-iscsi devstack@n-api.service[105831]: DEBUG dbcounter [-] [105831] Writing DB stats nova_api:SELECT=4 {{(pid=105831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:11.109274 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: worker 1 buried after 1 seconds Sep 11 00:00:11.109757 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: worker 2 buried after 1 seconds Sep 11 00:00:11.109757 dv-cinder-852009-6-iscsi devstack@n-api.service[105830]: goodbye to uWSGI. Sep 11 00:00:11.110890 dv-cinder-852009-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 11 00:00:11.111428 dv-cinder-852009-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 11 00:00:11.114361 dv-cinder-852009-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 00:00:11.123504 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 00:00:11 2022] *** Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: nodename: dv-cinder-852009-6-iscsi Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: machine: x86_64 Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: clock source: unix Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: pcre jit disabled Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: detected number of CPU cores: 4 Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: current working directory: / Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: detected binary path: /usr/bin/uwsgi-core Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: your processes number limit is 47680 Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: your memory page size is 4096 bytes Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: detected max file descriptor number: 2048 Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: lock engine: pthread robust mutexes Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: thunder lock: enabled Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 00:00:11.127619 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 00:00:11.166324 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: Python main interpreter initialized at 0x56135cc9b9c0 Sep 11 00:00:11.166324 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: python threads support enabled Sep 11 00:00:11.166324 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: your server socket listen backlog is limited to 100 connections Sep 11 00:00:11.166324 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: your mercy for graceful operations on workers is 90 seconds Sep 11 00:00:11.166807 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 00:00:11.166807 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: *** Operational MODE: preforking *** Sep 11 00:00:11.167071 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: *** uWSGI is running in multiple interpreter mode *** Sep 11 00:00:11.167071 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: spawned uWSGI master process (pid: 121065) Sep 11 00:00:11.167280 dv-cinder-852009-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 00:00:11.167871 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: spawned uWSGI worker 1 (pid: 121067, cores: 1) Sep 11 00:00:11.168225 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: spawned uWSGI worker 2 (pid: 121068, cores: 1) Sep 11 00:00:11.168399 dv-cinder-852009-6-iscsi devstack@n-api.service[121065]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 00:00:11.828281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 00:00:11.856631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 00:00:13.015744 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:00:13.015744 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: from cryptography.utils import int_from_bytes Sep 11 00:00:13.016360 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:00:13.016360 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: from cryptography.utils import int_from_bytes Sep 11 00:00:13.067790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:00:13.067790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: from cryptography.utils import int_from_bytes Sep 11 00:00:13.068367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:00:13.068367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: from cryptography.utils import int_from_bytes Sep 11 00:00:15.450758 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:00:15.451269 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:00:15.453841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:00:15.453841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:00:15.453841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:00:15.453841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.453841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.453841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.453841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.453841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.454462 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.454462 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.454940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.469429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.469429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.469429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.469429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-6-iscsi {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.469429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.469429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.469429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.469429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.470488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-6-iscsi {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.471867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.472913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.473304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.473304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.473304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.474368 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.474368 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.474368 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.474902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.474902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.475206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.475396 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.475713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.476046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.476463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.476723 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.477041 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.477384 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.477712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.478022 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.478367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.478726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.479026 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.479340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.479650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.479979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.480319 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.480627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.480882 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.481191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.481504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.481825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.482136 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.482449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.482788 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.483097 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.483412 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.483723 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.484034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.484344 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.484655 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.484966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.485279 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.485590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.486020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.486202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.486604 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.486968 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.487291 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.487600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.487906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.488221 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.488548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.488858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.489170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.489504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.489817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.490129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.490623 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.490910 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.491090 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.491527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.491705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.492023 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.492347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.492662 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.493283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.493283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.493573 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.493885 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.494200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.494508 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.494847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.495151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.495482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.495813 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.496132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.496444 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.496756 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.497079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.497430 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.497768 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.498117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.498442 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.498806 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.499145 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.499470 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.499787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.500107 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.500441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.500753 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.501069 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.501385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.501709 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.502035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.502942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.503261 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.503628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.503895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.504200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.504526 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.504858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.505191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.505510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.505858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.506213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.506534 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.506903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.507229 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.507547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.507864 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.508184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.508531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.508920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.509177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.509500 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.509821 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.510152 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.510474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.510814 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.511134 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.511453 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.511769 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.512122 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.512448 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.512780 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.513103 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.513424 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.513747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.514065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.514386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.514726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.515041 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.515352 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.515663 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.515979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.516288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.516620 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.517042 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.517270 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.517614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.518705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.518903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.519232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.519469 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.519801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.520185 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.520416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.520727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.521061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.521379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.521692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.522738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.522738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.522738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.523229 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.523390 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.523567 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.524283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.524283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.524618 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.524940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.525120 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.525461 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.525809 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.526119 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.526449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.526840 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.527169 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.527479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.527793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.528107 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.528419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.528739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.529054 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.529365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.529676 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.529983 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.530298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.530605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.530972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.531290 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.531597 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.531906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.532211 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.532564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.532876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.533228 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.533605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.533990 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.534374 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.534642 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.534993 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.535312 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.535632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.535949 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.536269 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.536691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.536902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.537225 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.537545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.537869 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.538179 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.538504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.538876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.539175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.539508 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.539852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.540217 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.540499 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.540818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.541141 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.541454 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.541769 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.542092 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.542401 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.542750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.543070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.543395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.543707 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.544055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.544348 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.544675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.544987 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.545307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.545643 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.545980 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.546297 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.546615 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.546970 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.547286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.547667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.547913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.548226 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.548538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.548859 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.550040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.550427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.550747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.551064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.551555 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.551728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.551994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.552302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.552616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.552944 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.553261 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.553587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.553913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.554222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.554532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.554888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.555203 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.555516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.555826 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.556135 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.556489 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.556807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.557116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.557436 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.557778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.558072 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.558391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.558730 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.559054 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.559382 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.559702 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.560030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.560332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.560622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.560937 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.561253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.561669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.561890 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.562204 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.562478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:00:15.563000 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.563159 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:00:15.563305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.563305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.563597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:00:15.563741 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.563892 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:00:15.564038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:00:15.564182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.564339 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.564496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.564725 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.564886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.565042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.565244 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.565616 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.565794 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.565944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.566109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.566257 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.566402 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.566553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.566765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.566932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.567092 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.567246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.567390 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.567801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.568048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.568213 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.568366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.568519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-6-iscsi {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.568675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.568836 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.568997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.569163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.569308 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.569460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.569604 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.569764 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.569934 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.570261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.570560 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.570740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.570900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.571046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.571198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.571198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.571511 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.571925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.572087 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.572233 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.572390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.572555 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.572807 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.572964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.573119 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.573280 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.573441 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.573598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.573759 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.573952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.574117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.574263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.574418 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.574574 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.574757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.574908 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.575062 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.575221 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.575374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-6-iscsi {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.575521 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.575686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.575840 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.576004 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.576158 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.576312 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.576470 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.576624 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.576778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.576944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.577096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.577249 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.577402 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.577558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.577714 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.577877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.578049 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.578273 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.578447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.578725 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.578909 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.579058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.579211 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.579364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.579519 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.579674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.579842 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.579998 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.580163 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.581085 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.581240 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.581385 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.581544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.581691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.582074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.582234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.582387 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.582543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.582720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.582978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.583129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.583274 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.583427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.583583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.583728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.583874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.584019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.584172 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.584322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.584481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.584629 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.584784 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.584933 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.585092 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.585248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.585401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.585547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.585701 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.585854 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.586018 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.586179 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.586325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.586477 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.586640 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.586810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.586966 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.587125 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.587271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.587415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.587560 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.587713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.587934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.588096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.588269 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.588493 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.588651 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.588814 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.588969 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.589116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.589261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.589413 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.589566 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.589750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.589914 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.590068 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.590256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.590407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.590567 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.590773 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.591261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.591431 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.591586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.591733 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.591911 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.592285 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.592437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.592591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.592743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.592895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.593144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.593306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.593475 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.593623 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.593775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.593928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.594081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.594236 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.594391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.594544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.594709 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.594860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.595005 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.595163 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.595317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.595474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.595627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.595780 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.596465 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.596465 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.596770 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.596915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.597066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.597218 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.597381 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.597535 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.597680 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.597825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.597986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.598131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.598288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.598441 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.598717 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.598883 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.599029 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.599174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.599333 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.599486 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.599632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.599776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.599927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.600089 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.600089 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.600373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.600525 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.600525 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.600808 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.600971 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.601288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.601507 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.601667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.601822 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.601975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.602281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.602529 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.602700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.602865 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.603012 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.603181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.603419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.603568 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.603714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.603874 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.604020 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.604171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.604324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.604468 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.604624 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.604782 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.604929 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.605080 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.605233 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.605233 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.605514 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.605675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.605825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.605971 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.606115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.606259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.606422 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.606567 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.606728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.606879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.607032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.607186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.607340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.607493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.607638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.607783 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.607927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.608071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.608230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.608394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.608547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.608727 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.608949 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.609100 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.609258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.609405 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.609549 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.609701 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.609857 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.610013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.610160 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.610313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.610476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.610630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.610829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.610989 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.611138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.611429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:00:15.611724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.611876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.612021 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.612177 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.612464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.612718 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.612893 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.613046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.613206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.613373 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.613629 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.613787 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.613939 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.614090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.614257 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.614409 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.614559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.614726 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.614884 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.615046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.615215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.615375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.615375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.615688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.615841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.615991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.616151 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.616303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.616462 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.616613 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.616764 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.616764 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.617075 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.617234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.617386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.617537 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.617688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.617848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.618008 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.618177 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.618390 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.618551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.618755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.618945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.619179 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.619335 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.619497 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.619650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.619809 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.619975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.620135 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.620287 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.620447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.620608 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.620773 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.620924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.621082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.621252 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.621252 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.621720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.621957 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.622114 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.622114 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.622544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.622544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.622887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.623055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.623208 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.623407 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.623579 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.623946 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.624101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.624262 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.624423 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.624583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.624736 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.624888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.625048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.625207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.625373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.625530 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.625681 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.625834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.626077 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.626232 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.626391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.626550 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.626750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.626910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.627097 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.627265 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.627417 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.627576 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.627727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.627887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.628059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.628212 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.628371 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.628535 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.628687 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.628848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.629001 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.629170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.629400 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.629564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.629564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.629861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.630015 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.630184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.630345 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.630504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.630675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.630849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.630849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.631149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.631149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.631442 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.631755 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.631938 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.632164 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.632328 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.632639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.632807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.632975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.633130 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.633289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.633442 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.633593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.633946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.634192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.634192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.634494 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.634654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.634852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.635027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.635191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.635358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.635522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.635682 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.635860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.636014 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.636175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.636328 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.636487 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.636639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.636799 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.636978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.637131 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.637315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.637481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.637633 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.637793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.637959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.638111 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.638269 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.638423 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.638575 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.638761 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.638927 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.639097 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.639258 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.639428 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.639650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.639806 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.639973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.640133 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.640286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.640286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.640582 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.640744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.640904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.641063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.641240 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.641394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.641546 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.641857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.642020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.642191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.642416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.642583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.643368 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.643481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.643575 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.643661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.643747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.643854 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.643996 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644296 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644556 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644648 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644822 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.644997 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645539 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645636 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645893 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.645976 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646065 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646249 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646333 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646414 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646733 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.646932 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647105 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647378 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647729 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647819 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.647899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648056 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648140 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648499 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648583 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648758 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648846 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.648936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649202 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649760 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.649932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650022 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650112 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650203 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650368 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650457 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650540 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650641 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650792 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.650986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651651 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651741 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.651970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652314 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652406 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652563 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652824 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652824 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.652964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653131 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653221 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653562 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653659 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.653871 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.654066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.654186 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.654450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.654625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.654910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.655064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.655217 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.655368 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.655519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.655685 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.655847 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.656008 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.656160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.656321 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.656472 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.656714 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.656869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.657019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.657186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.657338 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.657503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.657662 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.657814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.657971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.658137 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.658300 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.659167 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.659327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.659480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.659480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.659803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.660044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.660217 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.660371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.660522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.660673 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.660831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.660991 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.661167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.661320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.661481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.661641 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.661942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.662122 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.662283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.662443 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.662728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.662915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.663146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.663314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.663490 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.663734 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.663900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.664061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.664221 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.664387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.664652 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.664820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.664973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.665132 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.665292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.665454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.665608 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.665780 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.665947 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.666100 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.666100 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.666404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.666557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.666750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.666909 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.667061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.667226 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.667378 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.667538 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.667538 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.667844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.667997 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.668168 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.668328 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.668487 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.668639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.668799 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.668951 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.669111 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.669263 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.669422 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.669574 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.669731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.669731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.670073 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.670296 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.670459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.670619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.670815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.670980 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.671140 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.671307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.671469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.671632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.671794 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.672117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.672288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.672456 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.672617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.672856 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.673016 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.673264 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.673429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.673595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.673775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.674522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.674822 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.674982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.675162 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.675323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.675483 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.675636 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.675788 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.675941 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.676109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.676270 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.676432 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.676585 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.676744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.676896 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.677058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.677237 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.677391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.677551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.677705 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.677864 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.678026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.678026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.678330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.678482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.678634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.678832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.678996 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.679148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.679318 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.679479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.679637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.679874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.680042 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.680196 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.680435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.680593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.680745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.680911 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.681063 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.681214 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.681375 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.681539 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.681691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.681851 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.682005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.682303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.682470 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.682623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.682623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.683049 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.683240 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.683462 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.683619 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.683781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.683945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.684182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.684338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.684498 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.684651 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.684822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.685069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.685226 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.685378 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.685690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.685850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.686028 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.686189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.686342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.686492 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.686646 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.686927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.687083 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.687234 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.687386 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.687536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.687696 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.687857 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.688011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.688173 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.688332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.688491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.688652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.688818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.688971 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.689121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.689280 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.689431 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.689655 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.689917 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.690140 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.690447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.690752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.690917 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.691121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.691121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.691449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.691614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.691768 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.691923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.692173 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.692378 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.692784 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.692938 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.693194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.693354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.693644 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.693813 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.693975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.694129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.694368 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.694544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.694798 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.694960 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.695215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.695378 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.695532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.695705 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.695858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.696014 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.696166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.696326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.696479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.696641 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.696641 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.696937 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.697091 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.697243 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.697395 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.697577 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.697738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.697890 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.698042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.698202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.698370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.698530 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.698702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.698872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.699027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.699189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.699358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.699523 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.699691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.699855 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.700023 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.700176 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.700338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.700489 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.700649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.700890 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.701046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.701046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.701345 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.701497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.701660 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.701820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.701973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.702139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.702301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.702463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.702615 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.702820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.702983 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.703149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.703404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.703404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.703797 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.703974 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.704133 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.704414 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.704534 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.704626 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.704709 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.704786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.704887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.704965 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.705051 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.705740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.705850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.705927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706094 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706168 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706246 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706492 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706573 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.706785 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.708994 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709089 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709362 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709529 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.709971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710600 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710810 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710810 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710974 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.710974 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711535 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711624 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711813 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711898 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.711988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712072 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712251 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712555 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712639 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712735 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712837 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.712930 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713022 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713197 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713372 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713452 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713530 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713613 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713707 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713884 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.713967 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714047 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714119 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714209 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714387 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714618 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714809 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.714929 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715018 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715115 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715208 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715300 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715565 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715565 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715726 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.715919 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716012 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716354 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716686 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716854 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.716951 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717124 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717124 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717436 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717701 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717853 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.717978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.718156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.718338 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.718475 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.718673 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.718914 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.719093 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.719226 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.719428 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.719529 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.719748 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.720026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.720121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.720346 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.720440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.720598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:00:15.720691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.721546 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.721869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.722195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.722504 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.722844 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.723155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.723477 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.723799 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.724111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.724428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.724733 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.725058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.725377 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.725738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.726127 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.726751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.726882 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.727199 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.727523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.727848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.728157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.728464 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.728775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.729080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.729386 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.729789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.730015 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.730364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.730689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.731978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.731978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.731978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.731978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.732317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.732639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.732989 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.733313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.733667 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.733973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.734294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.734601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.734974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.735281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.735588 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.735931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.736238 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.736621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.737118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.737278 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.737559 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.737896 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.738545 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.738924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.739240 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.739565 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.739869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.740172 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.740481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.740785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.741088 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.741390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.741699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.742001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.742344 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.742654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.742994 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.743299 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.743618 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.743941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.744231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.744534 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.744834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.745176 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.745477 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.745803 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.746110 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.746431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.746770 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.747084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.747400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.747710 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.748027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.748336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.748689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.749067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.749387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.749703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.750019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.750563 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.750921 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.751237 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.751550 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.751861 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.752268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.752587 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.752900 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.753212 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.753523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.753833 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.754459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.754697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.755028 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.757906 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.758177 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.758725 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.759307 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.759947 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.760629 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.761220 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.763695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.763695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.763695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.763695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.763695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.763695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.763695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.763695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.764291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.764291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.764868 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.765290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.765630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.765955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.766617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.766956 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.767276 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.767603 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.768478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.768729 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.769044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.769354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.769658 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.769979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.770288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.770589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.770934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.771371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.772098 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.772458 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.772778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.773105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.773429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.773748 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.774057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.774381 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.774707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.775014 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.775331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.775640 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.775945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.776247 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.776556 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.776899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.777203 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.777509 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.777812 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.778138 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.778462 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.778828 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.784931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.785435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO dbcounter [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Registered counter for database nova_api Sep 11 00:00:15.785523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.785523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.785523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.786021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.786021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.786285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.786599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.786971 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.787286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.787829 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.788227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.788551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.788889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.789222 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.789630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.789939 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.790248 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.790571 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.790906 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.791215 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.791525 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.791835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.792144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.792454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.792763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.793072 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.793381 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.793689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.794048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.794364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.794698 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.795001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.795316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.795656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.795974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.796309 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.796607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.796923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.797232 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.797538 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.797846 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.798152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.798464 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.798826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.799229 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.799501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.800120 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.800439 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.801017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.801337 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.801425 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.801663 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804948 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.804948 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.805105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.805257 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_db.sqlalchemy.engines [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:00:15.805353 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.805629 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.805929 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.806231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.806544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.806858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.807175 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.807466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.807771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.808072 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.808376 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.808680 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.808979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.809272 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.809573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.809878 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.810178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.810481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.810805 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.811112 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.811414 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.811714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.812007 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writer thread running {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:00:15.812104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.812336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.812665 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.812976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.813296 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.813606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.813923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.814230 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.814549 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.814965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.815285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.815593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.815922 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.816227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.816535 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.816848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.817155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.817723 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.818029 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.818354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.818703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.819002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.819328 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.819644 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.819959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.820270 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.820577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.820902 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.821212 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.821524 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.821937 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.822160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.822468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.822802 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.823111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.823422 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.823746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.824052 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.824374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.824695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.825001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.825322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.825644 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.825988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.826298 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.826642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.826986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.827292 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.827601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.827904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:00:15.828142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:00:15.870691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.context [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f4b48d3-0a1e-4042-b9a7-615220ba0b82(cell1) {{(pid=121068) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 00:00:15.874752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:00:15.875232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:00:15.876812 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:00:15.877765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:00:15.878219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:00:15.880259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:00:15.882345 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO dbcounter [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Registered counter for database nova_cell0 Sep 11 00:00:15.886398 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO dbcounter [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Registered counter for database nova_cell1 Sep 11 00:00:15.892141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO dbcounter [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Registered counter for database nova_api Sep 11 00:00:15.898670 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_db.sqlalchemy.engines [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:00:15.898670 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_db.sqlalchemy.engines [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:00:15.902361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writer thread running {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:00:15.904479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writer thread running {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:00:15.913798 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:00:15.920273 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writer thread running {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:00:15.977468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.context [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f4b48d3-0a1e-4042-b9a7-615220ba0b82(cell1) {{(pid=121067) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 00:00:15.981480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:00:15.982139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:00:15.983888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:00:15.984626 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:00:15.985071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:00:15.987358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:00:15.989375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO dbcounter [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Registered counter for database nova_cell0 Sep 11 00:00:15.993499 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO dbcounter [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Registered counter for database nova_cell1 Sep 11 00:00:16.000772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:00:16.003823 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:00:16.009240 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writer thread running {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:00:16.011320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writer thread running {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:00:16.053867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO dbcounter [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Registered counter for database nova_cell0 Sep 11 00:00:16.060471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_db.sqlalchemy.engines [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:00:16.066300 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writer thread running {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:00:16.164546 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO dbcounter [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Registered counter for database nova_cell0 Sep 11 00:00:16.171457 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:00:16.176957 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writer thread running {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:00:16.391421 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: WARNING keystonemiddleware.auth_token [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:00:16.399412 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: WARNING keystonemiddleware.auth_token [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:00:16.517887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: WARNING keystonemiddleware.auth_token [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:00:16.525139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: WARNING keystonemiddleware.auth_token [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:00:16.754818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: WARNING keystonemiddleware.auth_token [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:00:16.761093 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: WARNING keystonemiddleware.auth_token [None req-a46e2ebd-51ab-4a2c-8a95-a2fc96971c24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:00:16.766889 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56135cc9b9c0 pid: 121068 (default app) Sep 11 00:00:16.877871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: WARNING keystonemiddleware.auth_token [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:00:16.883869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: WARNING keystonemiddleware.auth_token [None req-f8d965bf-1e28-4efc-a92c-158401d43a0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:00:16.889079 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56135cc9b9c0 pid: 121067 (default app) Sep 11 00:00:54.409051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=3 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:54.411297 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=3 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:54.420520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=3 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:54.420520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=3 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:54.420747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:54.420747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:54.420747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:54.420747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:00:55.604775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b6d539ec-3035-4b15-bcd2-94d8ff5e318f tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Action: 'create', calling method: .version_select at 0x7f5ab7773430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-360371232", "metadata": {"Type": "work"}}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:00:55.657447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a1a27958-d90a-4b61-b9ce-1ac6382b2529 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Action: 'create', calling method: .version_select at 0x7f5ab7776550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-486975115"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:00:57.854496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a1a27958-d90a-4b61-b9ce-1ac6382b2529 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.460903 Sep 11 00:00:57.866124 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Sun Sep 11 00:00:54 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3475 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 00:00:57.872578 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3581b253-8bcd-4919-89f1-938d3d527545 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab764b310>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:00:58.210715 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3581b253-8bcd-4919-89f1-938d3d527545 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 200 len: 344 microversion: 2.1 time: 0.343054 Sep 11 00:00:58.211748 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 2/2] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:00:57 2022] GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 344 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:00:58.672555 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b6d539ec-3035-4b15-bcd2-94d8ff5e318f tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.253438 Sep 11 00:00:58.672555 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1156 bytes} [Sun Sep 11 00:00:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4256 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 00:00:58.685934 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9866bcac-a72f-4e01-aea5-f16ed174cdbb tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab764b670>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:00:58.792860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9866bcac-a72f-4e01-aea5-f16ed174cdbb tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 200 len: 352 microversion: 2.1 time: 0.110813 Sep 11 00:00:58.793684 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 3/4] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:00:58 2022] GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:00:59.225772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-634ad3a1-c4a5-41ab-9c91-a6be39fdd04b tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab7648310>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:00:59.553024 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-634ad3a1-c4a5-41ab-9c91-a6be39fdd04b tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 200 len: 345 microversion: 2.1 time: 0.331483 Sep 11 00:00:59.554026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 2/5] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:00:59 2022] GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 345 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:00:59.574806 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ab6bcfa2-4240-4b3b-85c8-60b7e55e6e27 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Action: 'create', calling method: .version_select at 0x7f5ab764bd30>, body: {"snapshot": {"volume_id": "6977a8b3-bb12-43b8-a141-a55d3c8ee421", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-314010786"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:00:59.808021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f082819a-e7a8-448a-a258-c4cc8193a86e tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab7648a60>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:00.352968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f082819a-e7a8-448a-a258-c4cc8193a86e tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 200 len: 353 microversion: 2.1 time: 0.548859 Sep 11 00:01:00.353845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:00:59 2022] GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 353 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:01:00.367238 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4d89736c-2ff9-43b9-89a2-811b4d6908f2 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab75df160>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:00.625607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4d89736c-2ff9-43b9-89a2-811b4d6908f2 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 200 len: 353 microversion: 2.1 time: 0.259078 Sep 11 00:01:00.634896 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:00 2022] GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 353 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:01:00.649366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d29fd838-5438-4c40-8a3e-a370a5a7288d tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab7648d30>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:00.819732 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ab6bcfa2-4240-4b3b-85c8-60b7e55e6e27 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.249907 Sep 11 00:01:00.821286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 4/8] 10.222.0.17 () {60 vars in 1162 bytes} [Sun Sep 11 00:00:59 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:00.832313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-55567a45-aa9e-407d-996e-dc5703238055 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab75daf70>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:01.193392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d29fd838-5438-4c40-8a3e-a370a5a7288d tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 202 len: 0 microversion: 2.1 time: 0.548694 Sep 11 00:01:01.196746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:01:00 2022] DELETE /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:01:01.206798 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e008e49d-87ab-4353-b299-be43b5342e86 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab76485e0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:01.293210 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-55567a45-aa9e-407d-996e-dc5703238055 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5" status: 200 len: 286 microversion: 2.1 time: 0.465088 Sep 11 00:01:01.294051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Sep 11 00:01:00 2022] GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 => generated 286 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:01:01.315934 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3478bbaf-769f-424c-b868-767c69e918f2 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab75da670>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:01.427723 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e008e49d-87ab-4353-b299-be43b5342e86 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 200 len: 352 microversion: 2.1 time: 0.223591 Sep 11 00:01:01.427723 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:01 2022] GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 352 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:01:01.525325 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3478bbaf-769f-424c-b868-767c69e918f2 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.211905 Sep 11 00:01:01.525325 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1140 bytes} [Sun Sep 11 00:01:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:01:01.529046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b2c65c8c-70cf-4425-8585-878c7c3921c8 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab75df280>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:01.608823 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b2c65c8c-70cf-4425-8585-878c7c3921c8 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5" status: 200 len: 286 microversion: 2.1 time: 0.086245 Sep 11 00:01:01.611700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Sep 11 00:01:01 2022] GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:02.440224 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-21b6d744-f441-47dc-b383-2e36a586d6ab tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab764b790>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:02.526795 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-21b6d744-f441-47dc-b383-2e36a586d6ab tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 200 len: 352 microversion: 2.1 time: 0.093379 Sep 11 00:01:02.528482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:02 2022] GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:02.628998 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cc97a859-9470-4233-a570-ad73f3b47765 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab76483a0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:02.728221 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cc97a859-9470-4233-a570-ad73f3b47765 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5" status: 200 len: 286 microversion: 2.1 time: 0.109133 Sep 11 00:01:02.728982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Sep 11 00:01:02 2022] GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:03.548544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2c95330a-194e-4bcb-b142-7705631e914b tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab7776ee0>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:03.692981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2c95330a-194e-4bcb-b142-7705631e914b tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 200 len: 352 microversion: 2.1 time: 0.154526 Sep 11 00:01:03.698700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:03 2022] GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:03.750509 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-10ca5a57-f73b-4d72-9c08-8b22a6100c83 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab7648af0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:03.886136 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-10ca5a57-f73b-4d72-9c08-8b22a6100c83 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5" status: 200 len: 286 microversion: 2.1 time: 0.147390 Sep 11 00:01:03.887349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 9/17] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Sep 11 00:01:03 2022] GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:04.707985 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0265d469-def3-421f-9cf1-a66a9ae11301 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab75da820>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:04.869543 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0265d469-def3-421f-9cf1-a66a9ae11301 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 200 len: 352 microversion: 2.1 time: 0.165691 Sep 11 00:01:04.877906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 9/18] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:04 2022] GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:04.911358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a168ebe9-8d26-42a8-9be3-489eec47e6b9 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab75df670>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:04.991395 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a168ebe9-8d26-42a8-9be3-489eec47e6b9 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5" status: 200 len: 287 microversion: 2.1 time: 0.095917 Sep 11 00:01:04.994717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 10/19] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Sep 11 00:01:04 2022] GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:05.006723 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6937b280-9456-4f49-9a81-35f6f463448d tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab75da700>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:05.247841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6937b280-9456-4f49-9a81-35f6f463448d tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5" status: 202 len: 0 microversion: 2.1 time: 0.246318 Sep 11 00:01:05.248478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 10/20] 10.222.0.17 () {58 vars in 1254 bytes} [Sun Sep 11 00:01:04 2022] DELETE /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:01:05.259391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-66477095-32d1-47a5-90d1-21b233b7d54a tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab7648f70>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:05.330026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-66477095-32d1-47a5-90d1-21b233b7d54a tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5" status: 200 len: 286 microversion: 2.1 time: 0.073539 Sep 11 00:01:05.349942 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 11/21] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Sep 11 00:01:05 2022] GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:05.886978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6d6c9fb0-ef9b-476f-bdb3-09f6255e5c51 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Calling method '.version_select at 0x7f5ab764b550>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:05.961774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-6d6c9fb0-ef9b-476f-bdb3-09f6255e5c51 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] HTTP exception thrown: Volume 3cc9f74e-db0d-4723-9f8c-3d5b78bb455f could not be found. Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6d6c9fb0-ef9b-476f-bdb3-09f6255e5c51 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Request method failure captured: Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f HTTP/1.1 Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSU2DkkUwYU5cudSZ-Zh1rBEj_gcZJ-ThVWJxrrU7Ox26Av0iQFSOE-uHabBpCAeHRtJgBCPEeH36RLpkOL9RS8eiNWD-Kodub7JU9xSIegIozn5T5SMOKybCoWLtu8-0WwhqTU86mblCl9VJuxqUVsOQpejVmGTPIkoXJG5-P6ZmTM Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 41cfe24bec5d4adaa1c42c19634fe164 Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-VolumesGetTestJSON-1256990036 Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:01:05.968572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41cfe24bec5d4adaa1c42c19634fe164", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41cfe24bec5d4adaa1c42c19634fe164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41cfe24bec5d4adaa1c42c19634fe164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41cfe24bec5d4adaa1c42c19634fe164"}]}] Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-VolumesGetTestJSON-1256990036 Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 41cfe24bec5d4adaa1c42c19634fe164 Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-VolumesGetTestJSON-1256990036 Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-VolumesGetTestJSON-1256990036-project Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 2486a6099f3e46e1bdfc81dbc5b640a4 Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-VolumesGetTestJSON-1256990036-project Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Volume 3cc9f74e-db0d-4723-9f8c-3d5b78bb455f could not be found. Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '3cc9f74e-db0d-4723-9f8c-3d5b78bb455f'} Sep 11 00:01:05.970242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3cc9f74e-db0d-4723-9f8c-3d5b78bb455f could not be found. (HTTP 404) (Request-ID: req-7cd4c53a-af0a-4514-aed1-ce6be6f2d132) Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:05.971589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:01:05.972786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3cc9f74e-db0d-4723-9f8c-3d5b78bb455f could not be found. Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 00:01:05.973845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3cc9f74e-db0d-4723-9f8c-3d5b78bb455f could not be found. Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3cc9f74e-db0d-4723-9f8c-3d5b78bb455f could not be found. Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6d6c9fb0-ef9b-476f-bdb3-09f6255e5c51 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] Returning 404 to user: Volume 3cc9f74e-db0d-4723-9f8c-3d5b78bb455f could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6d6c9fb0-ef9b-476f-bdb3-09f6255e5c51 tempest-VolumesGetTestJSON-1256990036 tempest-VolumesGetTestJSON-1256990036-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f" status: 404 len: 109 microversion: 2.1 time: 0.096202 Sep 11 00:01:05.980605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 11/22] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:05 2022] GET /compute/v2.1/os-volumes/3cc9f74e-db0d-4723-9f8c-3d5b78bb455f => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:01:06.345614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a7681062-7a50-4c31-8af2-8ee143e96396 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab76488b0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:06.386983 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-a7681062-7a50-4c31-8af2-8ee143e96396 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] HTTP exception thrown: Snapshot a27e15df-5ea5-4373-a0ff-2b7297afa2a5 could not be found. Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a7681062-7a50-4c31-8af2-8ee143e96396 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Request method failure captured: Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 HTTP/1.1 Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSU2ybuqHyZxm6n-kQzp8lvWGsXhs9kiji9e1KedJrXsMimS9tTAl7RtPyIp142hXzPXKkVC00afcjcNNdMadyos8uKOUoV2Ahzbvg_XuA-n--0bdF_cLIGdm-M98glzGzabiqVFbtk4hLQXqUIDpJxZyW7lTOg-XjzMGzOKlykokD4 Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 61a75581f5eb4854959399c3b2d3a3fc Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:01:06.391852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_61a75581f5eb4854959399c3b2d3a3fc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61a75581f5eb4854959399c3b2d3a3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/61a75581f5eb4854959399c3b2d3a3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61a75581f5eb4854959399c3b2d3a3fc"}]}] Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 61a75581f5eb4854959399c3b2d3a3fc Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-VolumesSnapshotsTestJSON-829850917-project Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 7a4d4018f1f24a3c9b9172607545ad28 Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829850917-project Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Snapshot a27e15df-5ea5-4373-a0ff-2b7297afa2a5 could not be found. Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'a27e15df-5ea5-4373-a0ff-2b7297afa2a5'} Sep 11 00:01:06.393246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a27e15df-5ea5-4373-a0ff-2b7297afa2a5 could not be found. (HTTP 404) (Request-ID: req-5260cc75-33c0-487c-ae21-348c2e6218f2) Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:06.393996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:01:06.394959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a27e15df-5ea5-4373-a0ff-2b7297afa2a5 could not be found. Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 11 00:01:06.395986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a27e15df-5ea5-4373-a0ff-2b7297afa2a5 could not be found. Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a27e15df-5ea5-4373-a0ff-2b7297afa2a5 could not be found. Sep 11 00:01:06.396968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:06.399820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a7681062-7a50-4c31-8af2-8ee143e96396 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Returning 404 to user: Snapshot a27e15df-5ea5-4373-a0ff-2b7297afa2a5 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:01:06.405291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a7681062-7a50-4c31-8af2-8ee143e96396 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5" status: 404 len: 111 microversion: 2.1 time: 0.060794 Sep 11 00:01:06.405291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Sep 11 00:01:06 2022] GET /compute/v2.1/os-snapshots/a27e15df-5ea5-4373-a0ff-2b7297afa2a5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:01:06.420777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0181befd-1003-4ccd-854d-f7b01095a971 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab764be50>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:06.697065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0181befd-1003-4ccd-854d-f7b01095a971 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 202 len: 0 microversion: 2.1 time: 0.289135 Sep 11 00:01:06.699667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 12/24] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:01:06 2022] DELETE /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:01:06.716845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-210da24b-a32c-43ee-9e1d-c233e55b2ede tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab75dfca0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:06.848211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-210da24b-a32c-43ee-9e1d-c233e55b2ede tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 200 len: 344 microversion: 2.1 time: 0.142260 Sep 11 00:01:06.852033 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:06 2022] GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:07.869730 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d2fcc914-2c68-4ef2-9879-1e69b6d54060 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab75c8310>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:08.037959 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d2fcc914-2c68-4ef2-9879-1e69b6d54060 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 200 len: 344 microversion: 2.1 time: 0.176087 Sep 11 00:01:08.045569 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:07 2022] GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:08.633624 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f7937c4e-ead3-4091-93ea-41bb84eac343 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'create', calling method: .version_select at 0x7f5ab75c2310>, body: {"keypair": {"name": "tempest-keypair-1830820755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu6i/MlhTS2yb6fikqS++PhMZSGTTiD5nwkGDb3OVrddoADDkiwdlBj9tur1QzisvgdVUCPQuaTodSnNADXk3KofM+LKVDH8m9blOPOoX5FLkFb5AFKHWWxpReOcHsj8Q=="}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:08.757052 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-f7937c4e-ead3-4091-93ea-41bb84eac343 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Getting quotas for project 65f0209a8e48496c8d88c885f8364cbd. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:01:08.773285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-f7937c4e-ead3-4091-93ea-41bb84eac343 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Getting quotas for user 9950f578162449c0845c3aa4aab692d4 and project 65f0209a8e48496c8d88c885f8364cbd. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:01:08.963735 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f7937c4e-ead3-4091-93ea-41bb84eac343 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.035217 Sep 11 00:01:08.965858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 14/27] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:01:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:09.054962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b1cd230c-c565-4021-81f0-024ce12622c2 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab7553040>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:09.178207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b1cd230c-c565-4021-81f0-024ce12622c2 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 200 len: 344 microversion: 2.1 time: 0.127461 Sep 11 00:01:09.185771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 15/28] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:09 2022] GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:01:09.578426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-316064641", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "networks": [{"uuid": "e77bfdf4-2c29-4e45-9bd4-ca0a8435f1e8"}]}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:09.890772 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] validate_networks() for [('e77bfdf4-2c29-4e45-9bd4-ca0a8435f1e8', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:01:10.204163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cab98f42-ae52-49ff-8cbb-e14410c2fad0 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab7553790>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:10.301900 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-cab98f42-ae52-49ff-8cbb-e14410c2fad0 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] HTTP exception thrown: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cab98f42-ae52-49ff-8cbb-e14410c2fad0 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Request method failure captured: Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 HTTP/1.1 Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSU2ybuqHyZxm6n-kQzp8lvWGsXhs9kiji9e1KedJrXsMimS9tTAl7RtPyIp142hXzPXKkVC00afcjcNNdMadyos8uKOUoV2Ahzbvg_XuA-n--0bdF_cLIGdm-M98glzGzabiqVFbtk4hLQXqUIDpJxZyW7lTOg-XjzMGzOKlykokD4 Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 61a75581f5eb4854959399c3b2d3a3fc Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:01:10.305322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_61a75581f5eb4854959399c3b2d3a3fc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61a75581f5eb4854959399c3b2d3a3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/61a75581f5eb4854959399c3b2d3a3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61a75581f5eb4854959399c3b2d3a3fc"}]}] Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 61a75581f5eb4854959399c3b2d3a3fc Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-VolumesSnapshotsTestJSON-829850917-project Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 7a4d4018f1f24a3c9b9172607545ad28 Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829850917-project Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '6977a8b3-bb12-43b8-a141-a55d3c8ee421'} Sep 11 00:01:10.306461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. (HTTP 404) (Request-ID: req-af35180f-e054-4350-8be8-9cebfb73004a) Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:10.307186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:01:10.308370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 00:01:10.309411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cab98f42-ae52-49ff-8cbb-e14410c2fad0 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Returning 404 to user: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cab98f42-ae52-49ff-8cbb-e14410c2fad0 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 404 len: 109 microversion: 2.1 time: 0.119004 Sep 11 00:01:10.312357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 16/29] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:10 2022] GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:01:10.958035 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-379739361", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:11.127598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] validate_networks() for [('83085c38-54ce-4ec2-9f1f-78c3aabf2ddd', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:01:13.136500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:01:13.137682 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:01:13.138383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:01:13.138816 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:01:13.139454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:01:13.166460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:13.185915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:13.185915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:13.185915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:13.185915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:13.187135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:13.187230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:01:13.187230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:01:13.187230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:01:13.187230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:01:13.187230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:01:13.226518 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Getting quotas for project b0b35b1c14ba4a2e9b23a223628b449c. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:01:13.226896 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:13.232541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Getting quotas for user b8ceeb13c4c24ceb9ff1f27b4e45f62c and project b0b35b1c14ba4a2e9b23a223628b449c. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:01:13.235386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:13.236187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:13.237159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:13.237868 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:13.238464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:13.266960 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:01:13.269753 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:01:13.371568 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Getting quotas for project c748f4142cf54207a35d5d39b6cac877. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:01:13.399582 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Getting quotas for user 640a5815b1a545fc952ac67f553b6797 and project c748f4142cf54207a35d5d39b6cac877. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:01:13.431090 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:01:13.439457 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:01:13.537501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cb7f4d54-3c89-46a7-916a-178d5e673c8c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.205557 Sep 11 00:01:13.549271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 17/30] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:01:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 3212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:01:13.577925 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-25636a21-178a-4612-9c14-bcdcfd97fbe4 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab74728b0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:13.668832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-25636a21-178a-4612-9c14-bcdcfd97fbe4 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] HTTP exception thrown: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-25636a21-178a-4612-9c14-bcdcfd97fbe4 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Request method failure captured: Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 HTTP/1.1 Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSU2ybuqHyZxm6n-kQzp8lvWGsXhs9kiji9e1KedJrXsMimS9tTAl7RtPyIp142hXzPXKkVC00afcjcNNdMadyos8uKOUoV2Ahzbvg_XuA-n--0bdF_cLIGdm-M98glzGzabiqVFbtk4hLQXqUIDpJxZyW7lTOg-XjzMGzOKlykokD4 Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 61a75581f5eb4854959399c3b2d3a3fc Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:01:13.681649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_61a75581f5eb4854959399c3b2d3a3fc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61a75581f5eb4854959399c3b2d3a3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/61a75581f5eb4854959399c3b2d3a3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61a75581f5eb4854959399c3b2d3a3fc"}]}] Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 61a75581f5eb4854959399c3b2d3a3fc Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-VolumesSnapshotsTestJSON-829850917-project Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 7a4d4018f1f24a3c9b9172607545ad28 Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829850917-project Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '6977a8b3-bb12-43b8-a141-a55d3c8ee421'} Sep 11 00:01:13.683227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. (HTTP 404) (Request-ID: req-d58cc220-53fd-4eec-b77a-8ea3e936795a) Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:13.684037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 00:01:13.685531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 00:01:13.686772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-25636a21-178a-4612-9c14-bcdcfd97fbe4 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Returning 404 to user: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-25636a21-178a-4612-9c14-bcdcfd97fbe4 tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 404 len: 109 microversion: 2.1 time: 0.131548 Sep 11 00:01:13.688841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 18/31] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:01:13 2022] DELETE /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:01:13.697742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-02067af2-5b41-4495-a1b4-b7ca2d3042be tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.002676 Sep 11 00:01:13.698681 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 14/32] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 00:01:13.709762 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5abcb2dd-adee-44f5-9726-ed02d1b59f98 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:13.712884 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5abcb2dd-adee-44f5-9726-ed02d1b59f98 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:13.950988 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5abcb2dd-adee-44f5-9726-ed02d1b59f98 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:13.984925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5abcb2dd-adee-44f5-9726-ed02d1b59f98 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1221 microversion: 2.1 time: 0.281544 Sep 11 00:01:13.984925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 15/33] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:13 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1221 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:14.003709 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-15931229-2a9c-437e-b98d-60cb5dbd1a2c tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Calling method '.version_select at 0x7f5ab6c6d040>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:14.118221 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7f5a00ec-b380-43be-89f1-2ce16fb1aee4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'create', calling method: .version_select at 0x7f5ab74834c0>, body: {"keypair": {"name": "tempest-keypair-1381593336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBESSa0Poie3vxpB7EWF9vbO/+H6m7dJ0kvbV6AgZp3M+4I+5RzyrkwqNj2LJPRJrdB6C9BmCCvvEbqO30HZ9nfa67pj/IN9/CV6fF0SKAbwMkivKhaThBoVMx6oEBPug=="}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:14.151445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-15931229-2a9c-437e-b98d-60cb5dbd1a2c tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] HTTP exception thrown: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-15931229-2a9c-437e-b98d-60cb5dbd1a2c tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Request method failure captured: Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 HTTP/1.1 Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSU2ybuqHyZxm6n-kQzp8lvWGsXhs9kiji9e1KedJrXsMimS9tTAl7RtPyIp142hXzPXKkVC00afcjcNNdMadyos8uKOUoV2Ahzbvg_XuA-n--0bdF_cLIGdm-M98glzGzabiqVFbtk4hLQXqUIDpJxZyW7lTOg-XjzMGzOKlykokD4 Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 61a75581f5eb4854959399c3b2d3a3fc Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:01:14.153907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_61a75581f5eb4854959399c3b2d3a3fc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61a75581f5eb4854959399c3b2d3a3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/61a75581f5eb4854959399c3b2d3a3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/61a75581f5eb4854959399c3b2d3a3fc"}]}] Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 61a75581f5eb4854959399c3b2d3a3fc Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829850917 Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-VolumesSnapshotsTestJSON-829850917-project Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 7a4d4018f1f24a3c9b9172607545ad28 Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829850917-project Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '6977a8b3-bb12-43b8-a141-a55d3c8ee421'} Sep 11 00:01:14.155052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. (HTTP 404) (Request-ID: req-26b1420f-7dd9-436e-9c51-f0515539233c) Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:14.155689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:01:14.157258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 00:01:14.158329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-15931229-2a9c-437e-b98d-60cb5dbd1a2c tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] Returning 404 to user: Volume 6977a8b3-bb12-43b8-a141-a55d3c8ee421 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:01:14.159248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-15931229-2a9c-437e-b98d-60cb5dbd1a2c tempest-VolumesSnapshotsTestJSON-829850917 tempest-VolumesSnapshotsTestJSON-829850917-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421" status: 404 len: 109 microversion: 2.1 time: 0.172266 Sep 11 00:01:14.160128 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 16/34] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:01:13 2022] GET /compute/v2.1/os-volumes/6977a8b3-bb12-43b8-a141-a55d3c8ee421 => generated 109 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:01:14.168927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5a436107-0922-4976-a68a-ee61fd42eefa tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:14.168927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5a436107-0922-4976-a68a-ee61fd42eefa tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:14.174483 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-7f5a00ec-b380-43be-89f1-2ce16fb1aee4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Getting quotas for project 1c3ed6ff48b44385acef77c00e631b6e. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:01:14.181167 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-7f5a00ec-b380-43be-89f1-2ce16fb1aee4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Getting quotas for user a66188ce11bc403d9c657efd78f3019a and project 1c3ed6ff48b44385acef77c00e631b6e. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:01:14.316807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5a436107-0922-4976-a68a-ee61fd42eefa tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:14.341101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5a436107-0922-4976-a68a-ee61fd42eefa tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1214 microversion: 2.1 time: 0.176229 Sep 11 00:01:14.346845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 17/35] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:14 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:14.354369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7f5a00ec-b380-43be-89f1-2ce16fb1aee4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.668785 Sep 11 00:01:14.355991 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 19/36] 10.222.0.17 () {62 vars in 1200 bytes} [Sun Sep 11 00:01:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 680 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 00:01:14.421910 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-526763829", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:14.543601 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] validate_networks() for [('83085c38-54ce-4ec2-9f1f-78c3aabf2ddd', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:01:15.051508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-229362473", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdc07122-054b-4011-b388-fcaff21bba63"}], "security_groups": [{"name": "tempest-securitygroup--682619074"}], "key_name": "tempest-keypair-1830820755", "user_data": "}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:15.310549 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] validate_networks() for [('cdc07122-054b-4011-b388-fcaff21bba63', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:01:15.637728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:01:15.637728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:01:15.637728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:01:15.638248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:01:15.638379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:01:15.658745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:15.670833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:15.671292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:15.672079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:15.673300 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:15.673718 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:15.751829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Getting quotas for project b0b35b1c14ba4a2e9b23a223628b449c. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:01:15.770960 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Getting quotas for user b8ceeb13c4c24ceb9ff1f27b4e45f62c and project b0b35b1c14ba4a2e9b23a223628b449c. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:01:15.812867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:01:15.817571 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:01:16.028980 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ec303682-c087-445f-99b0-0fe0d6f51e62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.611676 Sep 11 00:01:16.033119 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:01:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:01:16.049593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-300d988b-fd22-4c06-889e-1e446c940af9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:16.061786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-300d988b-fd22-4c06-889e-1e446c940af9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:16.340587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-300d988b-fd22-4c06-889e-1e446c940af9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:16.416373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-300d988b-fd22-4c06-889e-1e446c940af9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1214 microversion: 2.1 time: 0.332127 Sep 11 00:01:16.416373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 19/38] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:16 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1214 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:16.416373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5cd05e94-14ea-4e55-99b2-de92293810ef tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:16.416373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5cd05e94-14ea-4e55-99b2-de92293810ef tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:16.507970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:01:16.509477 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:01:16.510768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:01:16.511801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:01:16.512440 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:01:16.531458 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:16.532250 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:16.533624 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:16.534750 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:16.540481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:16.541612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:16.548858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5cd05e94-14ea-4e55-99b2-de92293810ef tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:16.566213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5cd05e94-14ea-4e55-99b2-de92293810ef tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1221 microversion: 2.1 time: 0.192739 Sep 11 00:01:16.566932 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 20/39] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:16 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:16.654395 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Getting quotas for project 65f0209a8e48496c8d88c885f8364cbd. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:01:16.668181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Getting quotas for user 9950f578162449c0845c3aa4aab692d4 and project 65f0209a8e48496c8d88c885f8364cbd. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:01:16.686337 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:01:16.690973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:01:16.927129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f7eaf598-2a09-454b-93d1-ada717d7e7ae tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.884301 Sep 11 00:01:16.932025 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:01:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 00:01:16.948734 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-270bb6f4-178a-4cdc-a3f8-e33e47767d69 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:16.950496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-270bb6f4-178a-4cdc-a3f8-e33e47767d69 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:17.138245 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-270bb6f4-178a-4cdc-a3f8-e33e47767d69 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:17.154631 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-270bb6f4-178a-4cdc-a3f8-e33e47767d69 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1237 microversion: 2.1 time: 0.212400 Sep 11 00:01:17.160018 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 21/41] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:16 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1237 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:17.449736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:17.458628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:17.526427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:17.527168 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:17.532076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:17.534717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:17.535800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:17.536910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:17.594765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:17.599188 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:17.607264 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:17.613977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:17.615172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:17.616510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:17.616984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:17.617427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:17.992962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:18.039271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-dba92f2b-ec07-49b0-a85a-335844c965ef tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1218 microversion: 2.1 time: 0.600108 Sep 11 00:01:18.039862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 21/42] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:17 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1218 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:18.131202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:18.145408 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-68e8250f-66a9-4223-bedd-73b2f45df36c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1225 microversion: 2.1 time: 0.555181 Sep 11 00:01:18.146304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 22/43] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:17 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1225 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:18.184393 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-eebfd436-7560-4f63-91e7-08a0c5db9a77 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:18.185509 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-eebfd436-7560-4f63-91e7-08a0c5db9a77 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:18.262081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-eebfd436-7560-4f63-91e7-08a0c5db9a77 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:18.319456 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-eebfd436-7560-4f63-91e7-08a0c5db9a77 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1237 microversion: 2.1 time: 0.139940 Sep 11 00:01:18.323179 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 22/44] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:18 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1237 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:19.066281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:19.067373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:19.085734 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:19.086903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:19.087910 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:19.095386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:19.096215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:19.101694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:19.170174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:19.171639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:19.201179 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:19.201754 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:19.202207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:19.230367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:19.231012 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:19.231399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:19.278203 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:19.289215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4966a5a2-3ef6-4c49-84dc-7b4a35fad7e3 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1218 microversion: 2.1 time: 0.227934 Sep 11 00:01:19.304232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 23/45] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:19 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:19.350944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:19.351250 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:19.351250 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:19.362088 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fba0ecf5-f398-4167-96d7-7b9bfb3fbe14 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1225 microversion: 2.1 time: 0.197245 Sep 11 00:01:19.362466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:19.364881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:19.368157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:19.368157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:19.369205 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:19.369205 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:19.379431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 23/46] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:19 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1225 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:19.480375 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:19.493170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-701918485", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04880d1e-67f2-4152-a6c8-ba0d1911b4f5"}], "security_groups": [{"name": "tempest-securitygroup--659708237"}], "key_name": "tempest-keypair-1381593336", "user_data": "}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:19.499237 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0997a647-963c-4645-abfb-1eb82e70d155 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1241 microversion: 2.1 time: 0.155297 Sep 11 00:01:19.499876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 24/47] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:19 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:19.614617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] validate_networks() for [('04880d1e-67f2-4152-a6c8-ba0d1911b4f5', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:01:20.156155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:01:20.156732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:01:20.157211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:01:20.157713 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:01:20.158134 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:01:20.166788 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:20.167271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:20.167741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:20.168480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:20.168917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:20.169348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:20.187056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Getting quotas for project 1c3ed6ff48b44385acef77c00e631b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:01:20.197017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Getting quotas for user a66188ce11bc403d9c657efd78f3019a and project 1c3ed6ff48b44385acef77c00e631b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:01:20.210234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:01:20.220258 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:01:20.318598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:20.319087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:20.333381 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:20.333875 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:20.334309 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:20.335614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:20.336214 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:20.338061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:20.393117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-72caf1d4-db4f-4fe3-9360-96d34b950029 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.904241 Sep 11 00:01:20.416665 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 24/48] 10.222.0.17 () {62 vars in 1188 bytes} [Sun Sep 11 00:01:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 00:01:20.455060 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:20.455773 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:20.476020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:20.483045 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:20.483643 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:20.485128 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:20.485970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:20.486434 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:20.487409 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e8bc746b-63cb-44db-b6a8-207e31cc08c8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1210 microversion: 2.1 time: 0.173185 Sep 11 00:01:20.487705 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:20.514576 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 25/49] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:20 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1210 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:20.570138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-32c84022-2407-43be-8c2a-decb5e2b6170 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:20.571270 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-32c84022-2407-43be-8c2a-decb5e2b6170 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:20.572676 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:20.583612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-09797cbc-f460-4d29-9b55-d8be75290dd0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1217 microversion: 2.1 time: 0.163570 Sep 11 00:01:20.584412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 25/50] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:20 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:20.589878 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:20.591169 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:20.626292 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:20.629095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:20.630775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:20.640160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:20.640160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:20.640160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:20.783777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-32c84022-2407-43be-8c2a-decb5e2b6170 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:20.812495 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-32c84022-2407-43be-8c2a-decb5e2b6170 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:20.816321 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-32c84022-2407-43be-8c2a-decb5e2b6170 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:20.817481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-32c84022-2407-43be-8c2a-decb5e2b6170 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1281 microversion: 2.20 time: 0.301671 Sep 11 00:01:20.829106 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:20 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1281 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:20.912384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:20.922939 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5eec8d37-25f1-4ae7-b3ce-663513d551e1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1233 microversion: 2.1 time: 0.336658 Sep 11 00:01:20.934208 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 26/52] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:20 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1233 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:21.529394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:21.532320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:21.564305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:21.564853 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:21.565560 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:21.566711 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:21.581580 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:21.582484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:21.628303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:21.632113 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:21.650374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:21.651119 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:21.651943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:21.655194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:21.656427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:21.657346 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:21.758792 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:21.778125 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-45db418a-a1f4-4840-845f-52f70009245b tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1210 microversion: 2.1 time: 0.257656 Sep 11 00:01:21.781180 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 27/53] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:21 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1210 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:21.808241 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:21.818689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-717a7e65-5aa9-43c8-ba60-7a5a74edeb70 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1273 microversion: 2.1 time: 0.206119 Sep 11 00:01:21.825061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 27/54] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:21 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:21.847664 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5abae9ae-bf91-485e-a273-536a11574315 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:21.850172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5abae9ae-bf91-485e-a273-536a11574315 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:21.964351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:21.964873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:21.981131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:21.982118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:21.982919 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:21.984004 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:21.985308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:21.986109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:22.101747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5abae9ae-bf91-485e-a273-536a11574315 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:22.119184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5abae9ae-bf91-485e-a273-536a11574315 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:22.123948 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5abae9ae-bf91-485e-a273-536a11574315 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:22.124565 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5abae9ae-bf91-485e-a273-536a11574315 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1281 microversion: 2.20 time: 0.282490 Sep 11 00:01:22.130953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:22.131164 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 28/55] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:21 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:22.135121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-633c0687-b4fc-4d92-b5d8-b41ad4c57014 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1233 microversion: 2.1 time: 0.174920 Sep 11 00:01:22.153109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 28/56] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:21 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1233 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:22.805557 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:22.806175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:22.813952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:22.818161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:22.818161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:22.818161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:22.818161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:22.818577 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:22.860497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:22.861362 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:22.870595 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:22.870800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:22.871236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:22.871979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:22.872432 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:22.873074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:22.919780 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:22.928566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f2a5cf94-906b-4b6d-85fd-e159e77cced5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1266 microversion: 2.1 time: 0.126944 Sep 11 00:01:22.931172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 29/57] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:22 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:22.968324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:22.983515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-51c1c658-1717-4221-b0fd-0115714ef7e2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1281 microversion: 2.1 time: 0.136648 Sep 11 00:01:22.984366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 29/58] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:22 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:23.156007 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:23.159684 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:23.165878 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:23.166572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:23.168155 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:23.169382 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:23.170020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:23.170948 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:23.175253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:23.186343 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:23.186597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:23.186597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:23.186597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:23.186597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:23.186940 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:23.186940 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:23.248881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:23.259749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:23.261298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:23.262518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c882537f-995d-4570-8e37-4a9aa466bc5b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1285 microversion: 2.20 time: 0.112958 Sep 11 00:01:23.263872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 30/59] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:23 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:23.286513 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:23.294517 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5f4c0b3b-5dbd-47e9-8291-c2fd776ac910 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1233 microversion: 2.1 time: 0.132834 Sep 11 00:01:23.295288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 30/60] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:23 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1233 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:23.954387 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:23.956619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:23.968060 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:23.971002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:23.973461 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:23.976118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:23.976667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:23.977186 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:24.011912 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:24.013215 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:24.024772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:24.025621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:24.029096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:24.033201 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:24.033201 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:24.033201 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:24.070241 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:24.113563 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3fd47c69-fe61-4226-bd83-d934204c7534 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1266 microversion: 2.1 time: 0.163727 Sep 11 00:01:24.115273 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 31/61] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:23 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:24.163005 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:24.172813 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7d656182-f926-42bd-bb3e-cddf99e33657 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1281 microversion: 2.1 time: 0.165471 Sep 11 00:01:24.173601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 31/62] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:24 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:24.301651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:24.302425 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:24.322493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:24.322721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:24.323131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:24.324502 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:24.325140 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:24.326109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:24.328073 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:24.329393 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:24.333127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:24.346415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:24.348375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:24.348375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:24.348375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:24.348635 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:24.348926 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:24.430871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:24.439069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3f9939bf-f1f8-42fd-8eac-69a34af7c3a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1233 microversion: 2.1 time: 0.120318 Sep 11 00:01:24.440320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 32/63] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:24 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1233 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:24.443425 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:24.455583 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:24.457338 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:24.458810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5d3038a6-4678-4874-9572-b778251a4431 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1285 microversion: 2.20 time: 0.172400 Sep 11 00:01:24.459884 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:24 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:25.145656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:25.147251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:25.157550 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:25.158403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:25.159148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:25.160118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:25.161004 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:25.161664 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:25.206203 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:25.207619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:25.244115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:25.251375 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:25.254942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:25.255927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:25.260616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:25.261931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:25.351419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:25.386986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2367888c-045a-4d88-811a-13b8dfcb495c tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1266 microversion: 2.1 time: 0.246982 Sep 11 00:01:25.388040 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 33/65] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:25 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:25.467007 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:25.467007 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:25.474181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:25.477224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:25.477708 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:25.478624 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:25.485982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:25.486621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:25.494863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:25.511495 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-88764816-85a5-4d2f-af55-5d48055696db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1281 microversion: 2.1 time: 0.309768 Sep 11 00:01:25.526909 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 33/66] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:25 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1281 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:25.546553 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:25.549654 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:25.576845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:25.580295 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:25.581334 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:25.583422 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:25.584145 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:25.590642 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:25.679269 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:25.702469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cd2e261f-38d0-4ca2-ad83-35025f78d353 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1233 microversion: 2.1 time: 0.242246 Sep 11 00:01:25.705589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 34/67] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:25 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1233 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:25.715946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=4 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:25.797378 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:25.824084 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:25.826848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:25.832562 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d2d96984-8ad5-480b-a230-839413c20f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1277 microversion: 2.20 time: 0.300560 Sep 11 00:01:25.836177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:25 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1277 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:26.437160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:26.439777 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:26.446720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:26.447645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:26.448416 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:26.449574 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:26.450464 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:26.451105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:26.542742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:26.554117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:26.571474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:26.587615 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:26.587615 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:26.587615 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:26.587615 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:26.588048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:26.588127 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:26.611227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c23aabd7-543b-46d1-9960-740b1c9d965e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1266 microversion: 2.1 time: 0.179200 Sep 11 00:01:26.611849 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 35/69] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:26 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:26.726913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:26.742117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ee6572ea-e6b2-40fa-a05a-ba15ad8f072c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1279 microversion: 2.1 time: 0.202589 Sep 11 00:01:26.742778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 35/70] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:26 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1279 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:26.748547 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:26.751638 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:26.767037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:26.767865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:26.772565 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:26.773514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:26.774871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:26.776736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:26.870617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:26.871260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:26.887397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:26.889625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:26.892340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:26.899791 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:26.899791 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:26.899791 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:26.956527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:26.984075 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-00a48eb1-598f-44fa-aa8b-81e4e19ea650 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1233 microversion: 2.1 time: 0.248554 Sep 11 00:01:27.004461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 36/71] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:26 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1233 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:27.377213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:27.397564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:27.401180 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:27.403286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-678f3f2b-c4e6-434c-9058-53cbdad66969 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1277 microversion: 2.20 time: 0.537635 Sep 11 00:01:27.407416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:26 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1277 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:27.644702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:27.645298 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:27.659500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:27.659984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:27.660413 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:27.661229 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:27.663211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:27.664018 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:27.776863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:27.778433 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:27.787488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:27.789047 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:27.789683 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:27.790751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:27.791563 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:27.792190 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:27.804189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:27.814091 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0426007c-4cf1-4c84-8ad1-2365aa8ae198 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1284 microversion: 2.1 time: 0.174385 Sep 11 00:01:27.822552 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 37/73] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:27 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:28.026455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:28.028325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:28.045913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:28.047021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:28.047992 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:28.049295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:28.050098 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:28.051034 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:28.074247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:28.090769 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-376fc912-1950-4dbe-806e-9cabe1bb8e9c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.326053 Sep 11 00:01:28.096446 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 37/74] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:27 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:28.105880 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:28.442049 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:28.443306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:28.450909 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:28.462742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-55960948-e302-4a97-a898-4dfe084ce38a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1289 microversion: 2.1 time: 0.447887 Sep 11 00:01:28.463843 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:28.467369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 38/75] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:28 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1289 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:28.475061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:28.494031 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:28.497006 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:28.498856 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:28.500677 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:28.889870 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:28.901095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:28.905447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:28.908106 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-94988f5d-1cf7-4707-8ed8-3d1b72e211c6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1277 microversion: 2.20 time: 0.473205 Sep 11 00:01:28.911377 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:28 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1277 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:01:28.926839 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:28.928036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:28.937331 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:28.938908 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:28.941739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:28.942993 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:28.945680 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:28.946336 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:28.991776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-f15ac053-95e9-4b99-9e0a-d6ad2861f955 req-72ce4a23-1f62-4917-9f11-345da8718ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6501cde1-0dad-4b77-a8d3-39cc6b8ef289", "tag": "0ad72262-66bc-4d5d-bbde-9c1e7c90fdec"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:29.010148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-f15ac053-95e9-4b99-9e0a-d6ad2861f955 req-72ce4a23-1f62-4917-9f11-345da8718ee3 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.011661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-f15ac053-95e9-4b99-9e0a-d6ad2861f955 req-72ce4a23-1f62-4917-9f11-345da8718ee3 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.018638 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-f15ac053-95e9-4b99-9e0a-d6ad2861f955 req-72ce4a23-1f62-4917-9f11-345da8718ee3 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:29.050222 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-f15ac053-95e9-4b99-9e0a-d6ad2861f955 req-72ce4a23-1f62-4917-9f11-345da8718ee3 service nova] Creating event network-changed:0ad72262-66bc-4d5d-bbde-9c1e7c90fdec for instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 on hv-cinder-85200 Sep 11 00:01:29.055684 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-f15ac053-95e9-4b99-9e0a-d6ad2861f955 req-72ce4a23-1f62-4917-9f11-345da8718ee3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121067) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 00:01:29.055684 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-f15ac053-95e9-4b99-9e0a-d6ad2861f955 req-72ce4a23-1f62-4917-9f11-345da8718ee3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121067) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 00:01:29.055684 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.055684 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.055684 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:29.056129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.056129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.056129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:29.086336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.compute.rpcapi [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 00:01:29.095274 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] Releasing lock "compute-rpcapi-router" {{(pid=121067) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 00:01:29.116463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3c59fbfc-a2cb-4b15-a67e-93f845eeafe1 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283782 Sep 11 00:01:29.120348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 39/77] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:29.123028 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:29.126358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:29.127064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:29.127200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:29.131754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0c4b9d93-81a6-4b01-be14-e9cf1073117f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1272 microversion: 2.1 time: 0.219140 Sep 11 00:01:29.132326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 39/78] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:28 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:29.136711 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.137498 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.138094 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:29.139167 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.139622 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.140390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:29.381305 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:29.389129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fdfa0ad3-1107-4778-ba61-022b138518c1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.267607 Sep 11 00:01:29.389717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 40/79] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:29 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:29.493508 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:29.494115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:29.501074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.501561 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.501999 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:29.502724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.503202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.503619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:29.574114 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:29.587020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a60ccc5c-1e0c-4fdd-b7fb-25967b3c0e44 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1297 microversion: 2.1 time: 0.097214 Sep 11 00:01:29.589299 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 40/80] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:29 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:29.939762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:29.940369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:29.946447 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.962601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.962601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:29.962601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:29.962601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:29.962977 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.013487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:30.022344 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:30.023800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:30.024913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bfe148f1-1beb-43a3-b5ef-dd22be9cdb78 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1333 microversion: 2.20 time: 0.089667 Sep 11 00:01:30.026695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 41/81] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:29 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:30.154333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:30.154968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:30.161758 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.162238 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.162682 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.163428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.163892 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.164306 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.207927 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=28 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:30.212404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-253e157e-6b1b-4582-adb8-8df50dd079f0 req-76507561-dd29-4a73-b806-de8faa615c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19befee5-042c-4c4f-b62a-97895fa670e6", "tag": "58e33c04-4056-48ff-a50f-3c168b0b931e"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:30.224892 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-253e157e-6b1b-4582-adb8-8df50dd079f0 req-76507561-dd29-4a73-b806-de8faa615c25 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.225358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-253e157e-6b1b-4582-adb8-8df50dd079f0 req-76507561-dd29-4a73-b806-de8faa615c25 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.225781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-253e157e-6b1b-4582-adb8-8df50dd079f0 req-76507561-dd29-4a73-b806-de8faa615c25 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.244675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-253e157e-6b1b-4582-adb8-8df50dd079f0 req-76507561-dd29-4a73-b806-de8faa615c25 service nova] Creating event network-changed:58e33c04-4056-48ff-a50f-3c168b0b931e for instance 19befee5-042c-4c4f-b62a-97895fa670e6 on hv-cinder-85200 Sep 11 00:01:30.245201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-253e157e-6b1b-4582-adb8-8df50dd079f0 req-76507561-dd29-4a73-b806-de8faa615c25 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 00:01:30.245581 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-253e157e-6b1b-4582-adb8-8df50dd079f0 req-76507561-dd29-4a73-b806-de8faa615c25 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 00:01:30.246650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.252313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.252313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.252313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.252313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.252313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.259312 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.compute.rpcapi [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 00:01:30.260190 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] Releasing lock "compute-rpcapi-router" {{(pid=121068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 00:01:30.277306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-624f7400-4964-47c1-ab2e-b6d6727c74e1 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132902 Sep 11 00:01:30.281022 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 41/82] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:30.307502 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:30.315871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d496301b-e1a7-4176-8644-dc87974ae523 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.165250 Sep 11 00:01:30.316451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 42/83] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:30 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:30.412866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:30.413511 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:30.420161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.420653 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.421092 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.422336 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.422830 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.423252 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.562505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:30.571379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-55a530e2-399e-44e9-af3a-0ae56bc884ea tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.162726 Sep 11 00:01:30.583148 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 42/84] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:30 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:30.620627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:30.621247 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:30.627498 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.628069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.628501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.629184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:30.629630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:30.630051 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:30.694518 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:30.703735 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-813b6d8f-664d-4522-bf0f-806f390ea714 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1297 microversion: 2.1 time: 0.088268 Sep 11 00:01:30.704343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 43/85] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:30 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:31.051363 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:31.051972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:31.055087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:31.058381 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:31.058970 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:31.059402 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:31.060193 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:31.060655 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:31.061046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:31.124288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:31.132575 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:31.134049 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:31.135166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-019988c1-149d-420a-b90d-58d8e69b05e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1333 microversion: 2.20 time: 0.088590 Sep 11 00:01:31.135810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 43/86] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:31 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:01:31.339408 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:31.340007 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:31.346905 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:31.347378 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:31.347806 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:31.348476 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:31.348915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:31.349328 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:31.483568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:31.491817 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-85be4444-055a-44c2-b8e8-494efdbd59d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.156539 Sep 11 00:01:31.492391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 44/87] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:31 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:31.598525 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:31.600072 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:31.607736 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:31.608672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:31.609220 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:31.610494 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:31.611090 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:31.611714 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:31.726904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:31.727503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:31.738820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:31.739553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:31.740146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:31.741001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:31.741599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:31.742170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:31.788908 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:31.797467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7414317d-573f-4e40-8a79-7ad3b15c4345 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.205136 Sep 11 00:01:31.798617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 44/88] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:31 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:31.837226 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:31.847067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-51041dba-2433-4f2d-a7c5-2dc5e9f5920b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1297 microversion: 2.1 time: 0.124001 Sep 11 00:01:31.848361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 45/89] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:31 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1297 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:32.161304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:32.161915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:32.163837 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=26 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:32.177419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:32.177987 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:32.178546 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:32.180023 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:32.180752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:32.181183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:32.259035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:32.268420 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:32.269929 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:32.271109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a8024ffc-53ff-4f86-ab50-7855b1f38354 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1333 microversion: 2.20 time: 0.114836 Sep 11 00:01:32.272169 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 45/90] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:32 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:32.518388 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:32.519126 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:32.525237 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:32.525722 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:32.526304 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:32.527032 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:32.527491 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:32.527912 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:32.671505 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:32.672371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2554f2af-123c-435f-976a-7eb20b897e69 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.159010 Sep 11 00:01:32.673157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 46/91] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:32 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:32.821625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:32.837688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:32.837688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:32.837688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:32.837688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:32.838776 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:32.838776 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:32.838776 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:32.876480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:32.877511 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:32.890383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:32.891457 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:32.892387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:32.896537 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:32.897353 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:32.898416 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:33.021355 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:33.027310 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f3507d86-af46-4066-afbf-97857f6f08d7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1297 microversion: 2.1 time: 0.159943 Sep 11 00:01:33.028885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 47/92] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:32 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1297 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:33.105077 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:33.117964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-272e9103-805d-4561-a21d-8bf058b89467 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.300191 Sep 11 00:01:33.119149 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 46/93] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:32 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:33.451785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:33.451785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:33.451785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:33.451785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:33.452084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:33.452084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:33.452084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:33.452084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:33.679777 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:33.695532 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:33.696427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:33.697062 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:33.699702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:33.702487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0d6f853a-321f-4cf2-9a3d-fa8d936e3c55 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1333 microversion: 2.20 time: 0.407131 Sep 11 00:01:33.703255 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 48/94] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:33 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1333 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:33.735139 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:33.735989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:33.736663 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:33.739484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:33.740150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:33.743716 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:34.018681 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:34.031975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dfd7d7d0-5c62-43b6-be5d-eaf968587aa2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.340228 Sep 11 00:01:34.036110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 47/95] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:33 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:34.054155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:34.057901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:34.061439 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:34.062161 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:34.063936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:34.076508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:34.079482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:34.082407 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:34.148458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:34.149816 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:34.159396 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:34.160347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:34.160347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:34.160987 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:34.161439 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:34.161865 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:34.237324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:34.253936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5dae34d8-44d6-4f6b-a8e3-56b3098169c5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1307 microversion: 2.1 time: 0.204111 Sep 11 00:01:34.257907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 49/96] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:34 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:34.482742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:34.493288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-929b1b03-5f8b-4e1d-bbcf-93919e3893da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.350794 Sep 11 00:01:34.493879 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 48/97] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:34 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:34.742862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:34.743869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:34.753690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:34.757743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:34.759510 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:34.763159 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:34.763905 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:34.764620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:34.994332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:35.007766 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:35.011620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:35.012592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a23b7a75-fc12-47cb-a296-af0be5edd352 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1333 microversion: 2.20 time: 0.284672 Sep 11 00:01:35.023429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 50/98] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:34 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1333 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:35.149895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:35.149895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:35.149895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:35.149895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:35.151146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:35.151146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:35.151146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:35.151146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:35.287541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:35.288488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:35.295228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:35.295965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:35.296535 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:35.297941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:35.298540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:35.299115 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:35.462894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:35.468825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:35.472431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-daff2d4c-81c4-433e-9423-1d8cf4d29a73 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1295 microversion: 2.1 time: 0.189326 Sep 11 00:01:35.476492 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 51/99] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:35 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:35.480346 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-58998c94-f37e-41de-aa05-78cde21e5754 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.428456 Sep 11 00:01:35.482208 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 49/100] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:35 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:35.485631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-fd1ae2ad-371c-4747-a001-edf05f5272fc req-40ab73bc-3f9b-469f-8a87-32d749292f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a049d0ca-3247-4224-a1c7-712fd1549714", "tag": "f33dc6d9-627a-498e-84ed-3f44cf2fae5a"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:35.498959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-fd1ae2ad-371c-4747-a001-edf05f5272fc req-40ab73bc-3f9b-469f-8a87-32d749292f43 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:35.498959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-fd1ae2ad-371c-4747-a001-edf05f5272fc req-40ab73bc-3f9b-469f-8a87-32d749292f43 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:35.498959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-fd1ae2ad-371c-4747-a001-edf05f5272fc req-40ab73bc-3f9b-469f-8a87-32d749292f43 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:35.518384 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:35.519580 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:35.526121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:35.526617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:35.527087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:35.528309 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:35.529057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-fd1ae2ad-371c-4747-a001-edf05f5272fc req-40ab73bc-3f9b-469f-8a87-32d749292f43 service nova] Creating event network-changed:f33dc6d9-627a-498e-84ed-3f44cf2fae5a for instance a049d0ca-3247-4224-a1c7-712fd1549714 on hv-cinder-85200 Sep 11 00:01:35.529547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:35.530281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:35.552553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-fd1ae2ad-371c-4747-a001-edf05f5272fc req-40ab73bc-3f9b-469f-8a87-32d749292f43 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066463 Sep 11 00:01:35.557412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 52/101] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:35.730886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:35.740129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1d730498-3fb6-4eef-bb76-4be6f509ffe5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.226621 Sep 11 00:01:35.742349 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 50/102] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:35 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:36.041544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:36.074907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:36.074907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:36.074907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:36.074907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:36.076135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:36.076135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:36.076135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:36.216382 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:36.231493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:36.234446 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:36.237612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6d41ac73-fe76-4f76-ad28-d435ba1bb934 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1341 microversion: 2.20 time: 0.200815 Sep 11 00:01:36.257170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 53/103] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:36 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:36.514143 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:36.515154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:36.531244 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:36.532924 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:36.533541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:36.533884 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:36.534254 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:36.535110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:36.535817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:36.536569 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:36.553206 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:36.553775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:36.554207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:36.555027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:36.555484 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:36.555895 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:36.788181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:36.792233 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9ef4ae6b-4c6f-42c2-891b-6762991ab866 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.282709 Sep 11 00:01:36.792801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 51/104] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:36 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:36.798101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:36.798731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:36.804904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:36.805628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:36.806213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:36.807111 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:36.807731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:36.808291 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:37.037711 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:37.048107 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0b5ec4c0-060e-4428-872c-77a4cc000513 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.254076 Sep 11 00:01:37.053035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 52/105] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:36 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:37.124785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:37.132284 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9e702ea5-35c9-419a-96bc-4c9ed8dfd11f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.613198 Sep 11 00:01:37.132857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 54/106] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:36 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:37.264959 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:37.265411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:37.272749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:37.273242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:37.273666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:37.274360 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:37.274846 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:37.275271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:37.347259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:37.355452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:37.356906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:37.358000 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9f1caa1e-d632-401c-8346-470b3129db1a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1339 microversion: 2.20 time: 0.097104 Sep 11 00:01:37.358888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 53/107] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:37 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:37.822713 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:37.823267 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:37.829946 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:37.830429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:37.830896 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:37.831569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:37.832010 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:37.832421 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:37.968987 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:37.977247 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6d4f2158-d446-4cdb-a839-ac53d228d910 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.158523 Sep 11 00:01:37.977803 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 55/108] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:37 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:38.078218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:38.079300 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:38.085342 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:38.089447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:38.089447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:38.089447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:38.089447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:38.089819 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:38.157500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:38.158202 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:38.165293 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:38.165855 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:38.166437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:38.167154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:38.167593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:38.168007 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:38.172905 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:38.232395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:38.241239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fc1bd638-6130-4ee8-911b-bf46d14620d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.167327 Sep 11 00:01:38.242021 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 54/109] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:38 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:38.337934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:38.345879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-18e93368-9b60-4b19-9ef1-4d6f78ca7947 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.192253 Sep 11 00:01:38.346453 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 56/110] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:38 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:38.383361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:38.384060 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:38.390095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:38.390638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:38.391383 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:38.392191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:38.392700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:38.393180 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:38.454076 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:38.462923 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:38.465332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:38.466583 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5d24595e-3914-459a-8c60-ae31bf40f3e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1339 microversion: 2.20 time: 0.087112 Sep 11 00:01:38.472176 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 55/111] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:38 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:39.001968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:39.002599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:39.010147 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:39.010580 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:39.013620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:39.017935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:39.018437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:39.018905 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:39.085027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=8 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:39.193498 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:39.204469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-29ae1260-8644-414d-9b76-7aa327ae06d4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.207408 Sep 11 00:01:39.206443 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 57/112] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:38 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:39.265307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:39.266770 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:39.272793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:39.273605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:39.274267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:39.275832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:39.276484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:39.277113 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:39.369849 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:39.370454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:39.377898 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:39.378303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:39.378843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:39.379575 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:39.379995 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:39.380420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:39.482525 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:39.486694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:39.491949 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e9461cc7-5079-4557-8768-31ac551b8413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.230422 Sep 11 00:01:39.492710 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 56/113] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:39 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:39.497726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:39.498490 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:39.504948 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:39.505616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:39.506363 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:39.507826 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:39.508420 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:39.509076 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:39.560455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:39.573714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2d87810d-1b86-4401-985e-0c2964cef7a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.207552 Sep 11 00:01:39.583982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 58/114] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:39 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:39.600099 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:39.610223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:39.612007 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:39.613130 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-355b2179-d773-402e-a760-102f55317fcd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1339 microversion: 2.20 time: 0.119264 Sep 11 00:01:39.613835 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 57/115] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:39 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:40.236572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:40.237005 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:40.243757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:40.243988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:40.244370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:40.245056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:40.245504 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:40.245936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:40.516653 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:40.520287 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:40.528236 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:40.530889 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:40.532620 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:40.534459 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:40.535586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:40.536303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:40.536994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:40.741818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:40.750778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a112a042-c004-4166-be76-cbcf1897afdc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.238387 Sep 11 00:01:40.752718 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 58/116] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:40 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:40.757071 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:40.757674 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:40.763698 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:40.764251 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:40.764676 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:40.765347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:40.766091 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:40.766512 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:40.918964 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:40.931478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-87756306-6439-4595-a1ee-ce4f01396ee8 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.705471 Sep 11 00:01:40.932455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 59/117] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:40 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:40.938436 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:40.946966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3653b628-dfa4-47cb-b162-7a6d1f94f9f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.194073 Sep 11 00:01:40.947747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 59/118] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:40 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:40.951156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:40.952009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:40.958827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:40.959458 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:40.960165 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:40.961247 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:40.961985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:40.962598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:41.067968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:41.076388 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:41.083023 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:41.083023 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b4df37b4-691f-4c28-810e-46f06691fe92 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1339 microversion: 2.20 time: 0.145375 Sep 11 00:01:41.083023 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 60/119] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:40 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:41.775212 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:41.776366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:41.783056 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:41.785115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:41.785115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:41.785115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:41.785638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:41.786222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:41.941905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:41.949943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3b443afd-6818-427d-a164-ac6a3925fd0a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.178542 Sep 11 00:01:41.950527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 60/120] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:41 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:41.958189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:41.959502 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:41.974596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:41.974596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:41.974596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:41.974596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:41.974958 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:41.977076 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:41.977998 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:41.978463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:41.998007 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:41.998498 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:42.003310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:42.003310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:42.003310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:42.003310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:42.235942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:42.243813 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-661c81b6-9cca-40ae-8527-ac42dc2e58db tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.277535 Sep 11 00:01:42.244927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 61/121] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:41 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:42.246620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:42.256321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cd58ee5e-303c-4011-b3bf-9768065aa5f4 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.301894 Sep 11 00:01:42.256900 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 61/122] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:41 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:42.262587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:42.263262 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:42.278153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:42.279690 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:42.279690 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:42.279894 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:42.280269 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:42.280951 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:42.335260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-5657f1a1-f2e1-47d9-be0a-bd9c9553ef76 req-c6c1108a-5bd2-4cf1-86b8-ed3b26865c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "890c9ef2-f830-4f13-a0c4-53dfb10e08c0", "tag": "15a31cd2-b0f9-4ce0-a5d5-969cde3d23aa"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:42.344883 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-5657f1a1-f2e1-47d9-be0a-bd9c9553ef76 req-c6c1108a-5bd2-4cf1-86b8-ed3b26865c0a service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:42.345700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-5657f1a1-f2e1-47d9-be0a-bd9c9553ef76 req-c6c1108a-5bd2-4cf1-86b8-ed3b26865c0a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:42.346283 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-5657f1a1-f2e1-47d9-be0a-bd9c9553ef76 req-c6c1108a-5bd2-4cf1-86b8-ed3b26865c0a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:42.361142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-5657f1a1-f2e1-47d9-be0a-bd9c9553ef76 req-c6c1108a-5bd2-4cf1-86b8-ed3b26865c0a service nova] Creating event network-changed:15a31cd2-b0f9-4ce0-a5d5-969cde3d23aa for instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 on hv-cinder-85200 Sep 11 00:01:42.367208 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-5657f1a1-f2e1-47d9-be0a-bd9c9553ef76 req-c6c1108a-5bd2-4cf1-86b8-ed3b26865c0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035493 Sep 11 00:01:42.371377 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 62/123] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:01:42.450031 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:42.458117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:42.459589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:42.460696 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-43917efb-ab74-4539-8c18-e960e037a09a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.214134 Sep 11 00:01:42.461258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 62/124] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:42 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:42.975089 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:42.976015 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:42.983044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:42.984071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:42.986154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:42.987150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:42.992361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:42.992361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:43.271403 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:43.272011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:43.278059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:43.278541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:43.279010 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:43.279700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:43.280155 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:43.280575 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:43.408313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:43.412317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:43.416706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-14f4b704-59d5-4fe6-a482-dfe89390f00b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.445826 Sep 11 00:01:43.417275 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 63/125] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:42 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:43.420829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-57ca356d-a0a9-4d11-87df-98e65e135d27 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.153095 Sep 11 00:01:43.421879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:43.423100 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:43.429671 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:43.430319 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:43.430913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:43.431473 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 63/126] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:43 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:43.432114 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:43.432699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:43.433115 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:43.485879 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:43.486482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:43.492426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:43.492910 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:43.493346 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:43.494039 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:43.494487 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:43.494943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:43.622021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:43.622598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:43.626975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-232e8af5-8668-41e1-bae0-11b724422db5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.208085 Sep 11 00:01:43.627659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 64/127] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:43 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:43.632118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:43.633541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:43.634704 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1aded1a8-ef45-4874-80cc-828d2456e5cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.153240 Sep 11 00:01:43.638697 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 64/128] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:43 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:01:44.381790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-b9491f24-3120-4dad-b7f7-062e6b576f80 req-8f00eb8b-9ae9-4441-a17f-53291aaacae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b206b090-4c06-4bf1-a005-379f4056da27", "tag": "13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:44.392568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-b9491f24-3120-4dad-b7f7-062e6b576f80 req-8f00eb8b-9ae9-4441-a17f-53291aaacae4 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.393037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-b9491f24-3120-4dad-b7f7-062e6b576f80 req-8f00eb8b-9ae9-4441-a17f-53291aaacae4 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.393459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-b9491f24-3120-4dad-b7f7-062e6b576f80 req-8f00eb8b-9ae9-4441-a17f-53291aaacae4 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.404163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-b9491f24-3120-4dad-b7f7-062e6b576f80 req-8f00eb8b-9ae9-4441-a17f-53291aaacae4 service nova] Creating event network-changed:13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1 for instance b206b090-4c06-4bf1-a005-379f4056da27 on hv-cinder-85200 Sep 11 00:01:44.410870 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-b9491f24-3120-4dad-b7f7-062e6b576f80 req-8f00eb8b-9ae9-4441-a17f-53291aaacae4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032345 Sep 11 00:01:44.410870 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 65/129] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:44.441182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:44.441787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:44.445601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:44.446318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:44.448036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.448509 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.448945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.449625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.450071 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.450485 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.452384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.452842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.454209 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.454995 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.455504 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.455930 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.589422 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:44.595999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:44.599621 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4d517dc4-277d-4184-958d-efe777e0bd5d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.162972 Sep 11 00:01:44.600189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 65/130] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:44 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:44.609907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-68dac52f-ac2a-4d7a-85b4-cd7ce6c6ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.166438 Sep 11 00:01:44.609907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 66/131] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:44 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:44.649151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:44.649795 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:44.655711 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.656727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.657165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.657845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.658289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.658722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.661597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:44.662194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:44.668068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.668544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.671113 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.671113 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:44.671113 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:44.671113 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:44.798063 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:44.805485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:44.806708 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-df8bff2b-2716-47ae-9b7f-f873404f7a9e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.161169 Sep 11 00:01:44.807346 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 66/132] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:44 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:44.814980 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:44.816568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:44.817665 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-58d11edc-a95e-410a-a8d0-b5f74724014e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.159906 Sep 11 00:01:44.820185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 67/133] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:44 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:01:45.622947 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:45.623464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:45.633714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:45.634597 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:45.635155 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:45.635572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:45.635862 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:45.636955 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:45.637684 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:45.638438 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:45.646178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:45.647254 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:45.648288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:45.649548 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:45.650270 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:45.651061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:45.792673 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:45.793032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:45.801332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7582396f-65e4-42ef-bdb1-807c138f9bbd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.174027 Sep 11 00:01:45.801732 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e56d4439-f844-4749-b8e3-ed664620b7f7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.182697 Sep 11 00:01:45.801892 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 68/134] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:45 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:45.802288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 67/135] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:45 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:45.830578 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:45.831208 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:45.837191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:45.837669 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:45.838167 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:45.838880 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:45.839322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:45.839736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:45.842940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:45.843555 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:45.851973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:45.852469 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:45.852888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:45.853581 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:45.854150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:45.854685 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:46.005439 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:46.014376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:46.016326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:46.017514 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-edd3ec49-1ae0-4987-bdc0-b4bd1b6c2c97 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.178469 Sep 11 00:01:46.018142 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 68/136] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:45 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:01:46.120772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:46.129138 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a59e566b-e9d6-4c7e-940c-fd50a1e5db73 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.302766 Sep 11 00:01:46.130261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 69/137] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:45 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:46.823919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:46.824415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:46.824767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:46.824844 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:46.830920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:46.831139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:46.831728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:46.831859 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:46.832206 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:46.832332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:46.833125 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:46.833237 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:46.833594 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:46.833761 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:46.833980 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:46.834316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:46.973453 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:46.977614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:46.989419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7a1d7a7f-643f-42a7-b4f5-ff992d655412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.169514 Sep 11 00:01:46.990179 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 69/138] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:46 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:46.990487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e2b56271-74ef-4416-91ff-c0bd44f83e9e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.169729 Sep 11 00:01:46.991153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 70/139] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:46 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:47.043188 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:47.046906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:47.050296 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:47.050810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:47.051242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:47.051919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:47.052365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:47.052781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:47.152013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:47.152628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:47.159549 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:47.160027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:47.160455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:47.161131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:47.161570 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:47.161981 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:47.188544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:47.197463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:47.198963 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:47.200076 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5453ff64-8c77-46b8-be02-867f007f8b2e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.160893 Sep 11 00:01:47.200640 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 70/140] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:47 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:47.293247 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:47.300850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4aebb90f-381e-4070-9c3e-f38c2d23f6da tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.152630 Sep 11 00:01:47.301631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 71/141] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:47 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:48.017468 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:48.017960 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:48.018326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:48.018418 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:48.024087 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:48.024473 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:48.024570 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:48.024965 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:48.025119 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:48.025406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:48.025649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:48.026087 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:48.026194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:48.026500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:48.026622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:48.027030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:48.160590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:48.170755 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:48.173141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-da328a89-4b1e-477a-8709-2a3e9f128ddd tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.158791 Sep 11 00:01:48.173817 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 72/142] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:48 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:48.177660 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d8cc6010-c1ea-47c8-9921-46bf2830387e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.164007 Sep 11 00:01:48.178231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 71/143] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:48 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:48.225898 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:48.226548 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:48.232622 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:48.233098 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:48.233529 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:48.234252 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:48.235544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:48.235962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:48.327369 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:48.327369 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:48.330392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:48.330900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:48.331329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:48.332005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:48.332449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:48.332901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:48.375359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:48.384860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:48.386345 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:48.387493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-39eb7667-04dc-46f7-873c-4491c2fa6dd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.165692 Sep 11 00:01:48.388048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 73/144] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:48 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:48.463966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:48.472357 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-227720fc-42d3-4217-8b2c-7c3d756ea485 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.152514 Sep 11 00:01:48.472921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 72/145] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:48 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:49.196967 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:49.197569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:49.200118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:49.200942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:49.204217 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:49.204891 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:49.205318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:49.206027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:49.206599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:49.206903 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:49.207998 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:49.208553 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:49.209082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:49.209854 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:49.210360 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:49.210891 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:49.217884 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:49.231205 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:49.357229 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:49.361325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:49.365276 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-eef8188b-e60c-468e-a701-f9e7b1ca0f50 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.168964 Sep 11 00:01:49.365858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 73/146] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:49 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:49.369054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-972b8fe7-2a8b-4ae7-a572-fd261ec503bf tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.176476 Sep 11 00:01:49.369711 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 74/147] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:49 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:49.413883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:49.414481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:49.420629 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:49.421100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:49.421528 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:49.422481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:49.422928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:49.423345 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:49.495993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:49.496591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:49.502849 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:49.503327 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:49.503756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:49.504428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:49.504866 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:49.505275 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:49.556227 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:49.564322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:49.565752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:49.566881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3a3cf206-567a-4224-95a1-a631d3b270f1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.156857 Sep 11 00:01:49.567631 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 74/148] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:49 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:49.636963 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:49.644602 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f125c4ca-fea2-4c05-8c4c-3a4a5376d3d1 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.152730 Sep 11 00:01:49.645157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 75/149] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:49 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:50.388547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:50.389418 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:50.393026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:50.393784 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:50.396391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:50.396880 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:50.397316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:50.398052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:50.398448 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:50.398922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:50.399573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:50.400046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:50.400468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:50.401146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:50.401583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:50.401990 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:50.534744 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:50.538497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:50.543467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-cfc524d2-31d6-4e9b-82ab-25ea11293bf7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.158802 Sep 11 00:01:50.544051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 75/150] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:50 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:50.547439 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8bb754c7-f639-4bbc-ac48-c47622d69417 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.159311 Sep 11 00:01:50.548359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 76/151] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:50 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:50.591254 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:50.591997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:50.598689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:50.599260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:50.599761 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:50.600507 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:50.601020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:50.601502 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:50.667297 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:50.669738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:50.675050 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:50.675731 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:50.676163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:50.676844 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:50.677287 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:50.677869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:50.739374 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:50.747633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:50.749727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:50.751013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1447cba3-90eb-4859-9cc6-61200c126e75 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.162905 Sep 11 00:01:50.751825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 76/152] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:50 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:50.813132 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:50.821173 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c072752c-5ace-429e-9ccd-f54f262e48ad tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.157728 Sep 11 00:01:50.821722 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 77/153] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:50 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:51.567099 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:51.567713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:51.572033 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:51.572652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:51.573916 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:51.574406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:51.574879 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:51.575566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:51.576024 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:51.576445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:51.578460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:51.579158 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:51.579585 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:51.580257 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:51.580698 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:51.581109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:51.709452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:51.711791 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:51.717113 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ef09266b-0152-424e-880f-4d2d00f8fc83 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.154443 Sep 11 00:01:51.717683 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 77/154] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:51 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:51.719344 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b374e0a6-849a-4afd-96c1-8b0df02552bc tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.151382 Sep 11 00:01:51.719893 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 78/155] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:51 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:51.776656 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:51.777257 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:51.783175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:51.783650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:51.784081 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:51.784760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:51.785209 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:51.785630 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:51.845183 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:51.845816 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:51.851690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:51.852171 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:51.852606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:51.853285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:51.853733 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:51.854156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:51.917921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:51.927178 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:51.928609 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:51.929702 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-697168e2-d44b-476d-81ce-8055885411e3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.156840 Sep 11 00:01:51.930262 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 78/156] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:51 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:51.982066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:51.989720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9a29f100-9252-4734-a27e-acd33d17cabd tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.148589 Sep 11 00:01:51.990277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 79/157] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:51 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:52.742481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:52.744024 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:52.745286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:52.746523 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:52.752411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:52.753171 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:52.753598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:52.754562 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:52.755071 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:52.755248 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:52.755650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:52.755771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:52.756182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:52.756999 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:52.757522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:52.758270 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:52.904084 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:52.910211 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5b4046f4-86bd-4d20-81ad-325e712d4939 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.174090 Sep 11 00:01:52.910880 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 79/158] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:52 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:52.954781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:52.955444 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:52.960156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:52.961719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:52.962481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:52.963038 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:52.963798 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:52.964313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:52.964823 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:52.971711 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-04723aa0-82ab-45d5-ba69-ab4ce53d1d58 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.234123 Sep 11 00:01:52.972277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 80/159] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:52 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:53.014417 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:53.015089 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:53.021637 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:53.022115 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:53.022543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:53.023252 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:53.023819 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:53.024237 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:53.105113 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:53.115174 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:53.116803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:53.118019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c1db6b05-ca34-4f6a-9cef-071ac0b8bfd0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.167763 Sep 11 00:01:53.118778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 80/160] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:52 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:01:53.159899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:53.167932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-08030950-99c4-4296-8154-f52d2aa2fc52 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.158375 Sep 11 00:01:53.168786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 81/161] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:53 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:53.933452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:53.934064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:53.940078 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:53.940601 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:53.941034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:53.941711 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:53.942154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:53.942572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:53.994453 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:53.995020 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:53.997941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:54.002442 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:54.002942 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:54.003367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:54.004087 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:54.004678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:54.005091 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:54.074008 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:54.082611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e8a0564e-f6b9-4745-a794-2dd00e82b607 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.152855 Sep 11 00:01:54.083221 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 81/162] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:53 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:54.144617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:54.145414 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:54.152349 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:54.152836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:54.153265 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:54.153960 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:54.154406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:54.154865 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:54.297223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:54.305912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:54.311116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:54.311116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4a050d7e-a489-4fe5-a28b-6a5e4c00b870 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.168291 Sep 11 00:01:54.311116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 82/163] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:54 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:54.315574 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:54.316188 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:54.323602 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:54.324357 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:54.324877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:54.325586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:54.326041 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:54.326465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:54.338121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:54.345831 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f18f7ce2-576e-4876-a26c-7c9320295b1a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.355407 Sep 11 00:01:54.346393 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 82/164] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:53 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:54.455211 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:54.462744 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-54a97378-df01-4321-a35d-e7e6af04768e tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.152563 Sep 11 00:01:54.463306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 83/165] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:54 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:55.106256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:55.106894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:55.113149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:55.113620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:55.114046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:55.114754 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:55.115200 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:55.115629 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:55.249260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:55.258071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-585fb103-6e76-49d7-9a7a-636703eaa4e8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.155621 Sep 11 00:01:55.259914 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 83/166] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:55 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:55.335201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:55.335835 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:55.341804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:55.342280 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:55.342738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:55.343416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:55.344169 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:55.344644 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:55.368284 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:55.368918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:55.374719 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:55.375728 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:55.376153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:55.376826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:55.377265 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:55.377675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:55.473110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:55.481234 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:55.482685 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:55.483775 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bfbef199-22f0-46ff-aec5-2ea0a33064ab tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.152617 Sep 11 00:01:55.485106 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 84/167] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:55 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:55.489441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:55.490034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:55.495625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:55.496103 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:55.496586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:55.497675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:55.498118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:55.498569 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:55.547586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:55.570268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-220f2c88-59e8-42c1-bab6-2f86962d3b81 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.202053 Sep 11 00:01:55.572756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 84/168] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:55 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:55.652414 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:55.661658 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3cf60b4e-c1ec-4a62-9b8b-560c458fcbf6 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.175512 Sep 11 00:01:55.662286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 85/169] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:55 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:56.281373 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:56.281981 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:56.287913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.288390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.288826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.289620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.290067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.290481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.428589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:56.436535 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f1f00c4c-79be-42d1-bba8-ef101cc1a0e4 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.159154 Sep 11 00:01:56.447100 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 85/170] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:56 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:56.510571 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:56.511383 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:56.518021 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.518500 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.518991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.519643 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.520090 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.520505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.757869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:56.757869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:56.757869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.757869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.760455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.760455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.760455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.760455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.762537 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:56.765028 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:56.767782 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:56.769097 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dac2fa38-11f1-4007-953b-f85413d46d28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.262424 Sep 11 00:01:56.770130 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 86/171] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:56 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:01:56.776066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:56.776897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:56.784627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.791544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.791544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.791544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.791544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.791910 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.851179 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:56.859554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-57b148cf-20eb-4216-a9ed-3b6c80da0bb0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.254552 Sep 11 00:01:56.871798 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 86/172] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:56 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:56.944783 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:56.955801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-d9517037-e86a-49f4-aaff-c7075e7949c2 req-427d134b-d224-41cd-8424-f614ad566d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19befee5-042c-4c4f-b62a-97895fa670e6", "name": "network-vif-plugged", "status": "completed", "tag": "58e33c04-4056-48ff-a50f-3c168b0b931e"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:56.958985 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4bb086d5-985e-47e9-b1dd-2d0fe655a045 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.187387 Sep 11 00:01:56.959747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 87/173] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:56 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:56.967274 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-d9517037-e86a-49f4-aaff-c7075e7949c2 req-427d134b-d224-41cd-8424-f614ad566d44 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:56.969778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-d9517037-e86a-49f4-aaff-c7075e7949c2 req-427d134b-d224-41cd-8424-f614ad566d44 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:56.969778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-d9517037-e86a-49f4-aaff-c7075e7949c2 req-427d134b-d224-41cd-8424-f614ad566d44 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:56.983383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-d9517037-e86a-49f4-aaff-c7075e7949c2 req-427d134b-d224-41cd-8424-f614ad566d44 service nova] Creating event network-vif-plugged:58e33c04-4056-48ff-a50f-3c168b0b931e for instance 19befee5-042c-4c4f-b62a-97895fa670e6 on hv-cinder-85200 Sep 11 00:01:56.989393 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-d9517037-e86a-49f4-aaff-c7075e7949c2 req-427d134b-d224-41cd-8424-f614ad566d44 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116338 Sep 11 00:01:56.989988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 87/174] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:57.459938 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:57.460649 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:57.467351 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:57.467869 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:57.468306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:57.469144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:57.469593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:57.470019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:57.605517 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:57.613216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-838dbc80-0d63-47f4-81a4-85633ef6739d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.156995 Sep 11 00:01:57.616115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 88/175] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:57 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:57.797130 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:57.798268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:57.805548 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:57.806358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:57.806843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:57.807541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:57.807974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:57.808395 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:57.889978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:57.889978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:57.896823 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:57.897323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:57.897756 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:57.898595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:57.899066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:57.899546 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:57.980090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:57.993002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:57.995469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:57.998041 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-58f255f0-492b-4422-abe0-0a42516b77ef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.205929 Sep 11 00:01:57.999173 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 88/176] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:57 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:01:58.005628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:58.006676 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:58.015496 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:58.016290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:58.017726 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:58.018720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:58.019475 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:58.020987 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:58.092184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:58.101156 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-511edefd-b62f-42bd-b7f7-f4ea50a7cd3e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.218112 Sep 11 00:01:58.102428 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 89/177] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:57 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:58.171548 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:58.180697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8990f14f-f12d-48e1-905f-f0eb1d0fb6e5 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.180043 Sep 11 00:01:58.181259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 89/178] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:57 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:58.637029 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:58.638240 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:58.646902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:58.648002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:58.648002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:58.648499 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:58.651284 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:58.659301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:58.664682 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:01:58.816224 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:58.825771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-30cc1b3c-dbf0-4f5f-9236-10b9a390bab2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.192710 Sep 11 00:01:58.826878 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 90/179] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:58 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:59.004495 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-25834bf8-440a-41fb-8137-17427d4f8313 req-935a0431-a5f8-494b-a75b-6cfe0bf21d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6501cde1-0dad-4b77-a8d3-39cc6b8ef289", "name": "network-vif-plugged", "status": "completed", "tag": "0ad72262-66bc-4d5d-bbde-9c1e7c90fdec"}, {"server_uuid": "a049d0ca-3247-4224-a1c7-712fd1549714", "name": "network-vif-plugged", "status": "completed", "tag": "f33dc6d9-627a-498e-84ed-3f44cf2fae5a"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:01:59.014546 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-25834bf8-440a-41fb-8137-17427d4f8313 req-935a0431-a5f8-494b-a75b-6cfe0bf21d94 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.015100 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-25834bf8-440a-41fb-8137-17427d4f8313 req-935a0431-a5f8-494b-a75b-6cfe0bf21d94 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.015524 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-25834bf8-440a-41fb-8137-17427d4f8313 req-935a0431-a5f8-494b-a75b-6cfe0bf21d94 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.026261 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:59.027100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:59.030969 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-25834bf8-440a-41fb-8137-17427d4f8313 req-935a0431-a5f8-494b-a75b-6cfe0bf21d94 service nova] Creating event network-vif-plugged:0ad72262-66bc-4d5d-bbde-9c1e7c90fdec for instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 on hv-cinder-85200 Sep 11 00:01:59.031424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-25834bf8-440a-41fb-8137-17427d4f8313 req-935a0431-a5f8-494b-a75b-6cfe0bf21d94 service nova] Creating event network-vif-plugged:f33dc6d9-627a-498e-84ed-3f44cf2fae5a for instance a049d0ca-3247-4224-a1c7-712fd1549714 on hv-cinder-85200 Sep 11 00:01:59.034279 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.034894 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.035433 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.036488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.037140 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.038014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.038344 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-25834bf8-440a-41fb-8137-17427d4f8313 req-935a0431-a5f8-494b-a75b-6cfe0bf21d94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037767 Sep 11 00:01:59.039184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 90/180] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:01:59.125018 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:59.125721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:59.138226 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.138775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.139246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.139944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.140427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.141011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.336589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:59.345187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:59.347349 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:59.348520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-73239608-937a-4fcf-a321-68e7be52cd69 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.326331 Sep 11 00:01:59.349096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 91/181] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:01:59 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:01:59.354259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:59.354972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:59.361559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.362637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.363109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.364002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.364562 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.364979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.378316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:59.390241 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b4078486-da49-4433-bd9c-cf2057a24b3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.269554 Sep 11 00:01:59.391180 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 91/182] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:59 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:01:59.548590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:01:59.557320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5f21c0e3-e13e-41d7-81b0-486235f51ea2 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.207250 Sep 11 00:01:59.558367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 92/183] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:59 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:01:59.863113 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:01:59.864389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:01:59.880185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.882332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.883128 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.884043 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:01:59.884674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:01:59.885297 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:01:59.890888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:00.333062 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:00.341314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9fa24329-1668-44d0-ba3f-e8cfffe1736a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1321 microversion: 2.1 time: 0.495484 Sep 11 00:02:00.341873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 92/184] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:01:59 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:00.376136 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:00.376834 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:00.380076 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:00.383532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:00.384215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:00.384692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:00.385592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:00.386507 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:00.387135 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:00.416717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:00.417518 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:00.423840 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:00.424413 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:00.424815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:00.425516 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:00.425968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:00.426782 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:00.554140 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:00.570259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:00.576896 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:00.579768 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fe252657-42e1-4ecc-8577-e84462bb29b0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.208336 Sep 11 00:02:00.582629 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 93/185] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:02:00 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:02:00.594265 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:00.594926 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:00.611548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:00.613118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:00.613912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:00.614714 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:00.620027 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:00.620632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:00.673355 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:00.683267 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-db3488f3-48b7-4ef4-8941-fc125f9ba216 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.271152 Sep 11 00:02:00.683867 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 93/186] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:00 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:00.827648 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:00.835897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f1ad6ccc-3267-4925-8037-a2e9e1708668 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.252025 Sep 11 00:02:00.836460 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 94/187] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:00 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:01.055437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-a2fcaf25-fa09-43e4-a691-77412ac9859a req-e5f03ecc-d271-417b-a9ff-caf1f20cfdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890c9ef2-f830-4f13-a0c4-53dfb10e08c0", "name": "network-vif-plugged", "status": "completed", "tag": "15a31cd2-b0f9-4ce0-a5d5-969cde3d23aa"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:02:01.063480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-a2fcaf25-fa09-43e4-a691-77412ac9859a req-e5f03ecc-d271-417b-a9ff-caf1f20cfdd3 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.063940 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-a2fcaf25-fa09-43e4-a691-77412ac9859a req-e5f03ecc-d271-417b-a9ff-caf1f20cfdd3 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.064569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-a2fcaf25-fa09-43e4-a691-77412ac9859a req-e5f03ecc-d271-417b-a9ff-caf1f20cfdd3 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.077407 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-a2fcaf25-fa09-43e4-a691-77412ac9859a req-e5f03ecc-d271-417b-a9ff-caf1f20cfdd3 service nova] Creating event network-vif-plugged:15a31cd2-b0f9-4ce0-a5d5-969cde3d23aa for instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 on hv-cinder-85200 Sep 11 00:02:01.083413 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-a2fcaf25-fa09-43e4-a691-77412ac9859a req-e5f03ecc-d271-417b-a9ff-caf1f20cfdd3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033605 Sep 11 00:02:01.084361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 94/188] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:01.364984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:01.365863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:01.371846 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.372326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.372760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.373443 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.373885 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.374304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.516339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:01.525524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-757f2610-26cc-4e3a-bde8-c03453a4764b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1515 microversion: 2.1 time: 0.164734 Sep 11 00:02:01.539054 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 95/189] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:01 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:01.550096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:02:01.552532 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:01.558775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.559321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.559790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.560484 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.560932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.561353 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.608373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:01.609810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:01.617171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.617943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.618554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.619466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.620053 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.620687 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.626640 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lazy-loading 'flavor' on Instance uuid 19befee5-042c-4c4f-b62a-97895fa670e6 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:02:01.825126 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:01.836652 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:01.840120 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:01.841768 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8f7f82b5-6fd7-49eb-9e72-05b2c05947ae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.237372 Sep 11 00:02:01.842494 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 96/190] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:02:01 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:02:01.859944 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:01.863644 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:01.872692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.873193 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.873617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.874310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:01.874771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:01.875361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:01.986150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c427fdfb-70c4-4beb-b6f3-93f68a110462 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6/action" status: 200 len: 32 microversion: 2.1 time: 0.440528 Sep 11 00:02:01.987858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 95/191] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:02:01 2022] POST /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:02:01.994318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:01.995038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:02.010941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:02.012032 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:02.013177 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:02.014059 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:02.014960 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:02.015591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:02.072922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:02.084098 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f3f6535a-5d70-4564-982c-2b86e0dff0be tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.239885 Sep 11 00:02:02.084694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 97/192] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:01 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:02.089988 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:02.095139 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:02.115248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:02.119866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:02.120316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:02.121032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:02.121538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:02.121955 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:02.232069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:02.240671 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-999da992-7b75-42e9-92d2-a3a670f0a489 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1314 microversion: 2.1 time: 0.251282 Sep 11 00:02:02.241235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 96/193] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:01 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:02.284178 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:02.292316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dc8e6179-a34c-4e06-be21-4eccb8ad3edd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.205813 Sep 11 00:02:02.292887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 98/194] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:02 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:02.869349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:02.870076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:02.877985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:02.878551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:02.879001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:02.879884 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:02.880324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:02.880901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:03.042885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:03.055373 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:03.056829 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:03.058020 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e0cd8009-4547-4dea-8fc6-035590c70cc9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.192516 Sep 11 00:02:03.058999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 97/195] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:02:02 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:02:03.110545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:03.111223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:03.127709 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:03.131259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:03.131712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:03.132449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:03.133066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:03.133542 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:03.262481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-7003c0a3-a08d-407c-a3f2-d9dc9a136562 req-79531e1d-a78d-4963-b2fc-f6fe4afac789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b206b090-4c06-4bf1-a005-379f4056da27", "name": "network-vif-plugged", "status": "completed", "tag": "13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:02:03.315581 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7003c0a3-a08d-407c-a3f2-d9dc9a136562 req-79531e1d-a78d-4963-b2fc-f6fe4afac789 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:03.316122 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7003c0a3-a08d-407c-a3f2-d9dc9a136562 req-79531e1d-a78d-4963-b2fc-f6fe4afac789 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:03.318509 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7003c0a3-a08d-407c-a3f2-d9dc9a136562 req-79531e1d-a78d-4963-b2fc-f6fe4afac789 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:03.344211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-7003c0a3-a08d-407c-a3f2-d9dc9a136562 req-79531e1d-a78d-4963-b2fc-f6fe4afac789 service nova] Creating event network-vif-plugged:13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1 for instance b206b090-4c06-4bf1-a005-379f4056da27 on hv-cinder-85200 Sep 11 00:02:03.346506 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:03.355455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-7003c0a3-a08d-407c-a3f2-d9dc9a136562 req-79531e1d-a78d-4963-b2fc-f6fe4afac789 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098351 Sep 11 00:02:03.357793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 98/196] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:03.365144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2643d269-984a-414f-aba2-d39fe420cdb3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.259433 Sep 11 00:02:03.369410 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:03.370312 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:03.377557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:03.378438 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:03.378558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:03.380585 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:03.384218 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:03.385409 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:03.392202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 99/197] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:03 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:03.405971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:03.406581 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:03.418219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:03.418983 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:03.419867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:03.420707 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:03.421469 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:03.422032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:03.587134 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:03.587865 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:03.597379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-04204168-4889-4e3d-aac8-49880e647d0e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.200740 Sep 11 00:02:03.598131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cb15facc-caf2-4e21-9b54-4d2d08066dfb tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1500 microversion: 2.1 time: 0.237818 Sep 11 00:02:03.598262 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 100/198] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:03 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:03.599001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 99/199] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:03 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:04.087174 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:04.087174 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:04.091274 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:04.091758 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:04.092192 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:04.092882 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:04.093415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:04.093801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:04.262363 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:04.275937 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:04.275937 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:04.276339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-511a4790-8283-4027-a551-7ae847ca53b6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.196456 Sep 11 00:02:04.287349 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 101/200] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:02:04 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:02:04.390135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:04.390806 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:04.397672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:04.398362 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:04.399064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:04.399913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:04.400571 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:04.401127 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:04.624728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:04.624728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:04.630691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:04.631248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:04.631786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:04.632537 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:04.633055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:04.633660 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:04.756907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:04.766039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-312ab9da-15c2-4bff-9826-fc67cce849a5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.379624 Sep 11 00:02:04.767034 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 100/201] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:04 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:04.849231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:04.864395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-90a7ff49-7c4d-468c-bf3f-e4e068db174b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.247106 Sep 11 00:02:04.865092 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 102/202] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:04 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:05.311312 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:05.315419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:05.322865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:05.323829 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:05.324516 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:05.325430 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:05.325884 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:05.326407 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:05.494559 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:05.504460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:05.506109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:05.507460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b6cf7e28-51ad-4fa9-8366-1d7bc41b2d91 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.202435 Sep 11 00:02:05.508195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 101/203] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:02:05 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:02:05.779958 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a048201-c38e-42dc-8970-fb0c895e30ff"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:02:05.782379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:05.789549 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:05.790033 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:05.790152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:05.790463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:05.790725 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:05.791187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:05.791625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:05.792051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:05.816443 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:05.817146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:05.818046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:05.820117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:05.820964 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:05.822131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:06.097906 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:06.105829 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b63e3535-4cfc-4c54-9127-676713ba7a4b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1362 microversion: 2.1 time: 0.319649 Sep 11 00:02:06.106908 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 102/204] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:05 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:06.111795 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:06.113739 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:06.120985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:06.121937 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:06.122642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:06.123635 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:06.124771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:06.125318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:06.301493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:06.309434 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a09976e9-0748-465e-b6a8-8e0dcdd67d9e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.201272 Sep 11 00:02:06.310320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 103/205] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:06 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:06.534366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:06.535010 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:06.541048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:06.541729 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:06.542157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:06.542881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:06.543515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:06.543924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:06.699054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:06.707519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:06.708963 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:06.713022 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-029f5fc2-3818-4319-896c-2adc2573e2c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1406 microversion: 2.20 time: 0.180307 Sep 11 00:02:06.713022 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 104/206] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:02:06 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:02:07.132679 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:07.133621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:07.140151 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:07.140762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:07.141266 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:07.142076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:07.142638 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:07.143247 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:07.314077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:07.323447 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6561c3fd-23eb-466b-ba57-c5d74b8fe710 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1548 microversion: 2.1 time: 0.197754 Sep 11 00:02:07.324261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 105/207] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:07 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1548 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:07.343830 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:07.344530 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:07.351259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:07.351740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:07.352172 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:07.352852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:07.353295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:07.353714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:07.534811 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:07.543243 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-085e3bdf-1a35-4564-8b91-573930b11131 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.203214 Sep 11 00:02:07.547831 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 106/208] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:07 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:07.552076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:07.552726 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:07.558868 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:07.559362 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:07.559968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:07.560675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:07.561157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:07.561584 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:07.644775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-42aaf59b-6fe3-4722-a9ba-10d5aecbc930 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099736 Sep 11 00:02:07.645369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 107/209] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Sep 11 00:02:07 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:07.735847 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:07.736451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:07.743800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:07.744304 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:07.744797 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:07.745414 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:07.745859 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:07.746274 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:07.767814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:08.012405 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:08.024297 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:08.026325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:08.027808 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-243e5dfd-c8d3-4a3b-bf0e-80f848aee7c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1597 microversion: 2.20 time: 0.296203 Sep 11 00:02:08.028686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 108/210] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:02:07 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1597 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:02:08.064016 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:08.065799 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:08.077975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:08.078758 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:08.082649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:08.082649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:08.082649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:08.082649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:08.478627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cce65591-92b6-4f24-84e4-343793764640 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.421068 Sep 11 00:02:08.481082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 109/211] 10.222.0.17 () {60 vars in 1316 bytes} [Sun Sep 11 00:02:08 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-interface => generated 284 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:02:08.570101 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:08.570821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:08.578130 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:08.578639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:08.579260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:08.579985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:08.580466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:08.580885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:08.881974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:08.890473 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6c05ecf3-a8c2-4b4f-82b3-de1d18e76181 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.325917 Sep 11 00:02:08.906742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 110/212] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:08 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:09.471254 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-ee062685-ca4b-474a-acfa-cf1ca46fb4d7 req-48b5b1e4-7c92-4e85-ad71-1a2d2b329a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "890c9ef2-f830-4f13-a0c4-53dfb10e08c0", "tag": "15a31cd2-b0f9-4ce0-a5d5-969cde3d23aa"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:02:09.481425 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-ee062685-ca4b-474a-acfa-cf1ca46fb4d7 req-48b5b1e4-7c92-4e85-ad71-1a2d2b329a7a service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:09.482045 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-ee062685-ca4b-474a-acfa-cf1ca46fb4d7 req-48b5b1e4-7c92-4e85-ad71-1a2d2b329a7a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:09.482582 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-ee062685-ca4b-474a-acfa-cf1ca46fb4d7 req-48b5b1e4-7c92-4e85-ad71-1a2d2b329a7a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:09.504317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-ee062685-ca4b-474a-acfa-cf1ca46fb4d7 req-48b5b1e4-7c92-4e85-ad71-1a2d2b329a7a service nova] Creating event network-changed:15a31cd2-b0f9-4ce0-a5d5-969cde3d23aa for instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 on hv-cinder-85200 Sep 11 00:02:09.522262 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-ee062685-ca4b-474a-acfa-cf1ca46fb4d7 req-48b5b1e4-7c92-4e85-ad71-1a2d2b329a7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048630 Sep 11 00:02:09.522262 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 111/213] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:02:09.914885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:09.915702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:09.930022 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:09.934865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:09.939631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:09.941260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:09.944282 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:09.945690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:10.120572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:10.138028 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1d87ea41-269b-4dab-b7c6-26fb273673b3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.218859 Sep 11 00:02:10.151476 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 112/214] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:09 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:10.230872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-7e33a5f7-de49-4a8c-b25a-e934099d1c59 req-185bffa0-5f09-412e-9edf-9b9db1eeb6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b206b090-4c06-4bf1-a005-379f4056da27", "tag": "13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:02:10.241752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7e33a5f7-de49-4a8c-b25a-e934099d1c59 req-185bffa0-5f09-412e-9edf-9b9db1eeb6a0 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:10.242513 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7e33a5f7-de49-4a8c-b25a-e934099d1c59 req-185bffa0-5f09-412e-9edf-9b9db1eeb6a0 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:10.243321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7e33a5f7-de49-4a8c-b25a-e934099d1c59 req-185bffa0-5f09-412e-9edf-9b9db1eeb6a0 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:10.271671 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-7e33a5f7-de49-4a8c-b25a-e934099d1c59 req-185bffa0-5f09-412e-9edf-9b9db1eeb6a0 service nova] Creating event network-changed:13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1 for instance b206b090-4c06-4bf1-a005-379f4056da27 on hv-cinder-85200 Sep 11 00:02:10.279465 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-7e33a5f7-de49-4a8c-b25a-e934099d1c59 req-185bffa0-5f09-412e-9edf-9b9db1eeb6a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052496 Sep 11 00:02:10.280915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 113/215] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:02:11.163745 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:11.164636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:11.172144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:11.172387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:11.172881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:11.173689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:11.175927 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:11.176741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:11.388019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:11.398402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-676d2358-9f4e-4461-a1ca-4d67aedbcf62 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.238925 Sep 11 00:02:11.399115 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 114/216] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:11 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:11.874036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d267c0b0-50f8-486b-8d0a-e3544e73f192 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "POST /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.097828 Sep 11 00:02:11.881137 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 103/217] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:02:05 2022] POST /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714/os-volume_attachments => generated 194 bytes in 6100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:12.422583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:12.423216 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:12.430344 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:12.430935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:12.431429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:12.432179 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:12.432829 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:12.433359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:12.760311 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:12.785055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-816f16a2-81e4-49db-b20d-71afc6c96eaa tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.365815 Sep 11 00:02:12.793127 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 115/218] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:12 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:13.809681 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:13.810361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:13.817153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:13.817620 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:13.818301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:13.819101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:13.819541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:13.819957 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:13.963219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:13.971363 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ae4ee20e-c1be-46bc-be3f-976f705cb413 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.166188 Sep 11 00:02:13.982830 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 104/219] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:13 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:14.995752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:14.996899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:15.004354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:15.005483 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:15.006138 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:15.007116 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:15.007778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:15.008359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:15.197915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:15.205577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c5ca73d3-a1f6-40c2-a5de-addd73c6ab72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.213917 Sep 11 00:02:15.206582 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 116/220] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:14 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:16.229650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:16.230372 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:16.240009 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:16.240591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:16.241269 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:16.242082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:16.242642 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:16.243099 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:16.262186 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:16.380397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:16.389095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0260467d-683b-4171-ac77-a3701479cceb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.163269 Sep 11 00:02:16.390002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 105/221] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:16 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:17.412565 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:17.413255 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:17.419647 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:17.419647 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:17.420042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:17.420715 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:17.421155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:17.421566 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:17.563260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:17.572050 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6b28180e-1a27-4a6e-b60e-f396c7ed4de1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.163919 Sep 11 00:02:17.572615 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 117/222] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:17 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:18.596333 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:18.596930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:18.603338 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:18.603749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:18.604183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:18.604852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:18.605305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:18.605704 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:18.737919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:18.750854 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5e9daa4b-7886-4534-a4a0-0ff2276ef78e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.153980 Sep 11 00:02:18.750854 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 106/223] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:18 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:19.772619 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:19.773339 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:19.780702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:19.781264 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:19.781790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:19.782655 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:19.783917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:19.784399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:19.933179 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:19.941315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-dbacb6c3-2ef3-4ce1-a1ce-6e3fe1bdfc7c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.173539 Sep 11 00:02:19.941875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 118/224] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:19 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:20.964584 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:20.965188 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:20.971978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:20.972463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:20.972896 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:20.973586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:20.974030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:20.974691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:21.212294 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:21.220212 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-934cab5a-bf73-4d67-9231-c3d00c63e8d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.259434 Sep 11 00:02:21.220852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 107/225] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:20 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:21.959380 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:21.959844 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:21.968671 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:21.969827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:21.971262 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:21.972533 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:21.973323 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:21.974018 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:22.017804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:02:22.249347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:22.250967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:22.269176 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:22.271350 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:22.272139 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:22.276293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:22.277977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:22.280230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:22.494572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:22.503982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-35e9ea5f-d137-449b-ace8-d18e28165362 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.262207 Sep 11 00:02:22.504919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 108/226] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:22 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:22.505118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-856df2f5-e228-468c-94d8-0321f9997f9d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 204 len: 0 microversion: 2.1 time: 0.549232 Sep 11 00:02:22.505954 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 119/227] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:02:21 2022] DELETE /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:02:22.514109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:22.514750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:22.523973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:22.524748 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:22.525475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:22.526416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:22.526898 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:22.527326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:22.682955 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:22.694460 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0b89d1ce-e94c-44d5-bc7f-d27194075240 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1552 microversion: 2.1 time: 0.184303 Sep 11 00:02:22.696366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 109/228] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:22 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:23.530814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:23.531497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:23.538173 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:23.538821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:23.540934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:23.541650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:23.542122 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:23.542540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:23.679570 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:23.687707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-28db6bac-4c01-4886-b32e-196ce5445398 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.161209 Sep 11 00:02:23.688392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 120/229] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:23 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:23.720922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:23.722384 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:23.729253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:23.730057 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:23.730757 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:23.732290 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:23.732939 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:23.733511 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:23.889666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:23.898577 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4bc9cde6-abd6-4391-a06d-1a10f1fb2993 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1552 microversion: 2.1 time: 0.181589 Sep 11 00:02:23.899176 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 110/230] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:23 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:24.710531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:24.711259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:24.716609 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:24.718620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:24.719468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:24.725039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:24.725039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:24.725039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:24.725039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:24.903087 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:24.910084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d53eeb5b-ad66-4cd2-a18a-7b2a63357e72 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.203308 Sep 11 00:02:24.910650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 121/231] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:24 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:24.921596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:24.922346 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:24.929731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:24.934767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:24.934767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:24.934767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:24.934767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:24.935218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:25.073751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:25.086240 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-46285432-21ea-4296-984f-d2ca48d8112f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1552 microversion: 2.1 time: 0.168750 Sep 11 00:02:25.086913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 111/232] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:24 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:25.857903 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-21c7d313-2040-477e-b36a-3d549116f081 req-bda8152d-074a-441e-9af1-10c94ebf4d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a049d0ca-3247-4224-a1c7-712fd1549714", "name": "network-vif-deleted", "tag": "f33dc6d9-627a-498e-84ed-3f44cf2fae5a"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:02:25.870410 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-21c7d313-2040-477e-b36a-3d549116f081 req-bda8152d-074a-441e-9af1-10c94ebf4d6b service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:25.870917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-21c7d313-2040-477e-b36a-3d549116f081 req-bda8152d-074a-441e-9af1-10c94ebf4d6b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:25.871776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-21c7d313-2040-477e-b36a-3d549116f081 req-bda8152d-074a-441e-9af1-10c94ebf4d6b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:25.892010 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-21c7d313-2040-477e-b36a-3d549116f081 req-bda8152d-074a-441e-9af1-10c94ebf4d6b service nova] Creating event network-vif-deleted:f33dc6d9-627a-498e-84ed-3f44cf2fae5a for instance a049d0ca-3247-4224-a1c7-712fd1549714 on hv-cinder-85200 Sep 11 00:02:25.897855 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-21c7d313-2040-477e-b36a-3d549116f081 req-bda8152d-074a-441e-9af1-10c94ebf4d6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043710 Sep 11 00:02:25.898574 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 122/233] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:25.935388 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:25.937223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:25.949298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:25.949298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:25.949298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:25.949298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:25.949808 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:25.949808 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:26.099171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:26.107742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f2302ae7-8647-4b41-8cf7-97510acd40ff tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.177900 Sep 11 00:02:26.108311 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 112/234] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:25 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:26.109566 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:26.110261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:26.119185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:26.120421 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:26.120694 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:26.121756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:26.122391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:26.122852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:26.191681 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:26.200220 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-729eb7d3-16a8-4e26-ba01-adf6e6b4d9fc tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1345 microversion: 2.1 time: 0.094722 Sep 11 00:02:26.200721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 123/235] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:26 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:27.131819 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:27.132415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:27.139308 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:27.139782 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:27.140410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:27.141173 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:27.141770 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:27.142903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:27.224058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:27.225193 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:27.232612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:27.233381 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:27.234646 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:27.241371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:27.241844 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:27.242279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:27.287049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:27.287536 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:27.287968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:27.288410 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lazy-loading 'fault' on Instance uuid a049d0ca-3247-4224-a1c7-712fd1549714 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:02:27.297698 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:27.320011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6684315b-e155-480e-85fb-280c36453d23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.178782 Sep 11 00:02:27.320011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 113/236] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:27 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:27.360092 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a5815b1a545fc952ac67f553b6797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c748f4142cf54207a35d5d39b6cac877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:27.368903 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c441d93d-84bc-49b2-b308-1096939792c9 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 200 len: 1350 microversion: 2.1 time: 0.149640 Sep 11 00:02:27.369689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 124/237] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:27 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:28.334977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:28.335590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:28.342282 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:28.342804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:28.343238 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:28.343921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:28.344524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:28.344941 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:28.393082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:28.393687 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:28.399667 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:28.400147 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:28.400577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:28.401254 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:28.401700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:28.402114 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:28.420248 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] HTTP exception thrown: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Request method failure captured: Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 HTTP/1.1 Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVELQR36apTQ9ioov1GwgPYMkCu_azTqqdsTSEAIAY1WCvAnqmsbyoAkwVN1t9JYZfVyt4rzZ0usN054gv5aoSDyt9NMCnkhWUZtdalOtR-iJQGl54ZD0ET18Qe_zMmZaubpGBO6cEZzY7xZRRNQ_P4Wn4f3BN7PgooczF-UciRokA Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: c748f4142cf54207a35d5d39b6cac877 Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:02:28.425789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c748f4142cf54207a35d5d39b6cac877", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c748f4142cf54207a35d5d39b6cac877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c748f4142cf54207a35d5d39b6cac877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c748f4142cf54207a35d5d39b6cac877"}]}] Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: c748f4142cf54207a35d5d39b6cac877 Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-DeleteServersTestJSON-2116928413-project Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 640a5815b1a545fc952ac67f553b6797 Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-DeleteServersTestJSON-2116928413-project Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.427288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'a049d0ca-3247-4224-a1c7-712fd1549714'} Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:02:28.428049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.429389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.430597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Returning 404 to user: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:02:28.430597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e1100245-b7a5-4e97-9820-415dea74c297 tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 404 len: 111 microversion: 2.1 time: 0.038288 Sep 11 00:02:28.430597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 125/238] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:28 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:02:28.490015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:28.497977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0024b070-50a3-450c-b577-36af6e14b138 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.167277 Sep 11 00:02:28.498547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 114/239] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:28 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:28.547789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:28.550080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:28.556081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:28.556564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:28.562872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:28.562872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:28.562872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:28.562872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:28.563435 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:28.572377 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] HTTP exception thrown: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Request method failure captured: Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714/os-volume_attachments HTTP/1.1 Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVELQR36apTQ9ioov1GwgPYMkCu_azTqqdsTSEAIAY1WCvAnqmsbyoAkwVN1t9JYZfVyt4rzZ0usN054gv5aoSDyt9NMCnkhWUZtdalOtR-iJQGl54ZD0ET18Qe_zMmZaubpGBO6cEZzY7xZRRNQ_P4Wn4f3BN7PgooczF-UciRokA Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: c748f4142cf54207a35d5d39b6cac877 Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:02:28.574142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c748f4142cf54207a35d5d39b6cac877", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c748f4142cf54207a35d5d39b6cac877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c748f4142cf54207a35d5d39b6cac877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c748f4142cf54207a35d5d39b6cac877"}]}] Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: c748f4142cf54207a35d5d39b6cac877 Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-DeleteServersTestJSON-2116928413-project Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 640a5815b1a545fc952ac67f553b6797 Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-DeleteServersTestJSON-2116928413-project Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.575573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'server_id': 'a049d0ca-3247-4224-a1c7-712fd1549714'} Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:02:28.576374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:28.577693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:28.579009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Returning 404 to user: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:02:28.579009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b3eda795-adc5-4830-90c5-353b21a7268f tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031731 Sep 11 00:02:28.579009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 126/240] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:02:28 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:02:29.521707 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:29.522316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:29.528646 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:29.529124 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:29.529555 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:29.530270 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:29.530752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:29.531171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:29.669515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:29.678391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ba178bb9-cc5c-4d78-aa16-ea7022485cb6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.161035 Sep 11 00:02:29.679000 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 115/241] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:29 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:30.703368 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:30.704105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:30.712391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:30.713164 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:30.713758 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:30.714781 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:30.715232 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:30.715832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:30.858583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:30.867441 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cc8dea6b-8b44-4bd3-b3d0-daf84706f465 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.168530 Sep 11 00:02:30.868003 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 127/242] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:30 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:31.423793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:31.425309 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:31.427747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=45 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:31.432762 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:31.433250 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:31.433691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:31.434385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:31.434940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:31.446439 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:31.450272 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] HTTP exception thrown: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Request method failure captured: Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: DELETE /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 HTTP/1.1 Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVELQR36apTQ9ioov1GwgPYMkCu_azTqqdsTSEAIAY1WCvAnqmsbyoAkwVN1t9JYZfVyt4rzZ0usN054gv5aoSDyt9NMCnkhWUZtdalOtR-iJQGl54ZD0ET18Qe_zMmZaubpGBO6cEZzY7xZRRNQ_P4Wn4f3BN7PgooczF-UciRokA Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: c748f4142cf54207a35d5d39b6cac877 Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:02:31.455385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c748f4142cf54207a35d5d39b6cac877", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c748f4142cf54207a35d5d39b6cac877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c748f4142cf54207a35d5d39b6cac877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c748f4142cf54207a35d5d39b6cac877"}]}] Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: c748f4142cf54207a35d5d39b6cac877 Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-DeleteServersTestJSON-2116928413-project Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 640a5815b1a545fc952ac67f553b6797 Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-DeleteServersTestJSON-2116928413-project Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.456872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'a049d0ca-3247-4224-a1c7-712fd1549714'} Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:02:31.457706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.459183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.460548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Returning 404 to user: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:02:31.460548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c919b64f-fae8-4068-b025-5c7407b3076a tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 404 len: 111 microversion: 2.1 time: 0.036952 Sep 11 00:02:31.460548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 116/243] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:02:31 2022] DELETE /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:02:31.465851 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:31.466526 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] [instance: a049d0ca-3247-4224-a1c7-712fd1549714] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:31.473814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:31.474363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:31.474888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:31.475633 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:31.476164 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:31.476581 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:31.490979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] HTTP exception thrown: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Request method failure captured: Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 HTTP/1.1 Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVELQR36apTQ9ioov1GwgPYMkCu_azTqqdsTSEAIAY1WCvAnqmsbyoAkwVN1t9JYZfVyt4rzZ0usN054gv5aoSDyt9NMCnkhWUZtdalOtR-iJQGl54ZD0ET18Qe_zMmZaubpGBO6cEZzY7xZRRNQ_P4Wn4f3BN7PgooczF-UciRokA Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: c748f4142cf54207a35d5d39b6cac877 Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:02:31.492500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c748f4142cf54207a35d5d39b6cac877", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c748f4142cf54207a35d5d39b6cac877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c748f4142cf54207a35d5d39b6cac877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c748f4142cf54207a35d5d39b6cac877"}]}] Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: c748f4142cf54207a35d5d39b6cac877 Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-DeleteServersTestJSON-2116928413 Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-DeleteServersTestJSON-2116928413-project Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 640a5815b1a545fc952ac67f553b6797 Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-DeleteServersTestJSON-2116928413-project Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.493988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'a049d0ca-3247-4224-a1c7-712fd1549714'} Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:02:31.498493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. Sep 11 00:02:31.499820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:02:31.501394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] Returning 404 to user: Instance a049d0ca-3247-4224-a1c7-712fd1549714 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:02:31.501394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f6eb34d0-0421-4688-8fb6-96a53083a60d tempest-DeleteServersTestJSON-2116928413 tempest-DeleteServersTestJSON-2116928413-project] 10.222.0.17 "GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714" status: 404 len: 111 microversion: 2.1 time: 0.032252 Sep 11 00:02:31.501394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 128/244] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:31 2022] GET /compute/v2.1/servers/a049d0ca-3247-4224-a1c7-712fd1549714 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:02:31.889901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:31.890506 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:31.898449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:31.899161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:31.899991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:31.901483 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:31.902292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:31.902886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:32.360802 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:32.371713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5bc67b24-dbf2-484c-8bee-10c9835f58ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.485763 Sep 11 00:02:32.386778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 117/245] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:31 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:33.396743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:33.397341 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:33.403965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:33.404515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:33.405011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:33.405761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:33.406267 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:33.406791 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:33.622467 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:33.634399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-14e26702-6f00-4630-bfdb-bb40f18b544d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.241651 Sep 11 00:02:33.635142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 129/246] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:33 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:34.665336 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:34.666512 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:34.675654 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:34.677171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:34.679801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:34.679801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:34.679801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:34.679801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:34.860628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:34.874301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f27c332e-4277-44de-8576-2bb27d69178b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.218805 Sep 11 00:02:34.886853 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 118/247] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:34 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:35.898963 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:35.900079 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:35.911391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:35.912656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:35.914312 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:35.923009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:35.923490 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:35.924859 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:36.155533 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:36.163881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4b4c3d2e-1651-43bd-b205-ec9ffb4850a2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.268968 Sep 11 00:02:36.164487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 130/248] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:35 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:37.198984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:37.200541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:37.208823 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:37.209273 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:37.209701 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:37.210392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:37.210890 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:37.211317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:37.357603 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:37.365548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b5224622-1ee5-4b85-b9b3-ae3d63940a4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.173769 Sep 11 00:02:37.366116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 119/249] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:37 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:38.388596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:38.389204 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:38.396006 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:38.396482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:38.396912 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:38.397589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:38.398032 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:38.398449 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:38.683064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:38.691917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-38a15f44-f58a-429d-8aee-b543c7669116 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.307137 Sep 11 00:02:38.692483 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 131/250] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:38 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:39.715293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:39.715973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:39.723005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:39.723496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:39.723989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:39.724600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:39.725052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:39.725474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:39.855446 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:39.863646 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dd48b9b7-7001-459c-89da-3c08e768f253 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.152216 Sep 11 00:02:39.864211 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 120/251] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:39 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:40.887120 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:40.887876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:40.894345 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:40.894854 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:40.895287 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:40.895975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:40.896418 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:40.896833 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:41.048365 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:41.056796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5f5e6c4c-99c4-4e03-9d44-e3b178580e31 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.173446 Sep 11 00:02:41.057352 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 132/252] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:40 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:42.089652 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:42.090292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:42.098253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:42.098764 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:42.099204 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:42.099894 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:42.100511 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:42.100936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:42.232893 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:42.241564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-12d6520b-860b-4fc0-9985-8b57d783de35 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.160909 Sep 11 00:02:42.242164 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 121/253] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:42 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:43.195308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-605b2494-829b-4276-bc28-0cc186dbb4f6 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab68aba60>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:43.251671 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-605b2494-829b-4276-bc28-0cc186dbb4f6 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b4c5c329-c04f-4178-bd85-6d563b09bccb" status: 200 len: 350 microversion: 2.1 time: 0.062366 Sep 11 00:02:43.259897 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 133/254] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:02:43 2022] GET /compute/v2.1/os-volumes/b4c5c329-c04f-4178-bd85-6d563b09bccb => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:43.265763 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:43.266374 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:43.274458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:43.274830 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:43.275263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:43.276349 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:43.276803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:43.277223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:43.469223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:43.472665 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:43.477282 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c89e2fb9-ab98-44ab-9125-2b03bd1e4c8f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.215763 Sep 11 00:02:43.477845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 122/255] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:43 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:44.499983 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:44.500596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:44.511780 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:44.512343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:44.512802 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:44.514912 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:44.515385 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:44.516766 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:44.722251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:44.732366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c42d0c7f-2caf-4ea8-880f-150d1cc09f93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.236704 Sep 11 00:02:44.747718 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 134/256] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:44 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:44.949429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5b0b5146-509e-4e70-a47b-77490811da67 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab691d820>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:45.005811 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5b0b5146-509e-4e70-a47b-77490811da67 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d62fc68a-0c5c-45b4-9ce9-e5185c225464" status: 200 len: 350 microversion: 2.1 time: 0.060069 Sep 11 00:02:45.006456 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 123/257] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:02:44 2022] GET /compute/v2.1/os-volumes/d62fc68a-0c5c-45b4-9ce9-e5185c225464 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:45.757029 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:45.757645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:45.763709 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:45.764190 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:45.764623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:45.765313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:45.765762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:45.766187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:45.936945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:45.946187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0bee9c49-8782-4846-a6ca-d4dc72e5d33a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1521 microversion: 2.1 time: 0.193627 Sep 11 00:02:45.946776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 135/258] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:45 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:46.969616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:46.970989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:46.977596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:46.978075 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:46.978519 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:46.979238 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:46.979771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:46.980214 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:47.116877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:47.124692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-80003d41-c409-4024-a933-185b2a4bcb9b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1501 microversion: 2.1 time: 0.159391 Sep 11 00:02:47.125252 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 124/259] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:46 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:47.147337 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:47.147878 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:47.153692 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:47.154174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:47.154609 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:47.155316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:47.155766 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:47.156188 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:47.301938 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:47.311681 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-99fc4a62-c545-4609-bd29-1737dbe267af tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1515 microversion: 2.1 time: 0.168115 Sep 11 00:02:47.312334 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 136/260] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:47 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:47.580206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0484d7a3-0a07-46f7-a3dd-97fd694a506d tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab6a29310>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:47.755692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0484d7a3-0a07-46f7-a3dd-97fd694a506d tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/658d2a90-1d98-417b-a8f5-9864275a99d6" status: 200 len: 349 microversion: 2.1 time: 0.179360 Sep 11 00:02:47.756259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 125/261] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:02:47 2022] GET /compute/v2.1/os-volumes/658d2a90-1d98-417b-a8f5-9864275a99d6 => generated 349 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:47.770755 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f8518032-7c6a-4b60-8a39-375f994585a0 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab69aa040>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:48.551154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f8518032-7c6a-4b60-8a39-375f994585a0 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.784715 Sep 11 00:02:48.551706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 137/262] 10.222.0.17 () {58 vars in 1134 bytes} [Sun Sep 11 00:02:47 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:48.569043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d416d677-6f2c-486b-89c5-18ab84f5271c tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab6a3a670>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:48.662869 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d416d677-6f2c-486b-89c5-18ab84f5271c tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.100586 Sep 11 00:02:48.663465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 126/263] 10.222.0.17 () {58 vars in 1149 bytes} [Sun Sep 11 00:02:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:48.678214 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-de2a542f-f4c3-4754-a39c-e1e22d876ba6 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab68aba60>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:48.779299 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-de2a542f-f4c3-4754-a39c-e1e22d876ba6 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.105618 Sep 11 00:02:48.780793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 138/264] 10.222.0.17 () {58 vars in 1134 bytes} [Sun Sep 11 00:02:48 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:48.799529 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5392e47a-aa82-48a5-9d4c-ab6f034156ae tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab6938430>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:48.958144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5392e47a-aa82-48a5-9d4c-ab6f034156ae tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.166613 Sep 11 00:02:48.958825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 127/265] 10.222.0.17 () {58 vars in 1167 bytes} [Sun Sep 11 00:02:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:48.974353 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e01b1701-42b6-4e83-ac62-cb1373c6984c tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab6c13c10>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:49.258379 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e01b1701-42b6-4e83-ac62-cb1373c6984c tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.289362 Sep 11 00:02:49.259035 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 139/266] 10.222.0.17 () {58 vars in 1170 bytes} [Sun Sep 11 00:02:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:49.278340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-63817512-e9d3-435f-b735-207bcff9cbc3 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab6ace8b0>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:49.487548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-63817512-e9d3-435f-b735-207bcff9cbc3 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.213614 Sep 11 00:02:49.487548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 128/267] 10.222.0.17 () {58 vars in 1155 bytes} [Sun Sep 11 00:02:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:02:49.497743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-09eaf076-9429-4077-95d8-d600799dc3e8 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab68ab1f0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:49.635156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-09eaf076-9429-4077-95d8-d600799dc3e8 tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.140857 Sep 11 00:02:49.637010 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 140/268] 10.222.0.17 () {58 vars in 1188 bytes} [Sun Sep 11 00:02:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:02:49.656088 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-743760fd-97f2-451a-9ba4-e4f5b9ade08c tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] Calling method '.version_select at 0x7f5ab6947040>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:49.740244 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-743760fd-97f2-451a-9ba4-e4f5b9ade08c tempest-VolumesTestJSON-961841988 tempest-VolumesTestJSON-961841988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.088193 Sep 11 00:02:49.744541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 129/269] 10.222.0.17 () {58 vars in 1155 bytes} [Sun Sep 11 00:02:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:53.181333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:02:53.183864 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:53.192376 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:53.193465 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:53.194322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:53.195557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:53.196371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:53.197010 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:53.241532 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lazy-loading 'flavor' on Instance uuid 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:02:53.598042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-601c9391-f0d7-46d6-a025-26d0a1c39ff7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289/action" status: 200 len: 32 microversion: 2.1 time: 0.420613 Sep 11 00:02:53.599050 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 141/270] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:02:53 2022] POST /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289/action => generated 32 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:02:53.609760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:53.610376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:53.617778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:53.618504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:53.619157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:53.622815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:53.623316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:53.623936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:53.822282 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:53.832300 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-062b9771-cc24-4999-ab67-ef5838ae80bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.227636 Sep 11 00:02:53.832877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 130/271] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:53 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:54.859671 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:54.860649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:54.867706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:54.868197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:54.868766 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:54.869480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:54.870080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:54.870504 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:55.006067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:55.014234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d3f019c4-4a89-460f-8f91-d6c888a54412 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.159513 Sep 11 00:02:55.014865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 142/272] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:54 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:56.038622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:56.040688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:56.050804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:56.051364 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:56.051902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:56.052700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:56.053214 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:56.053700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:56.192526 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:56.201540 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-18d5ee42-524a-4cce-bdd2-0d771393fb20 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.167246 Sep 11 00:02:56.207053 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 131/273] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:56 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:57.231557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:57.239601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:57.246875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=36 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:02:57.256278 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:57.260862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:57.260862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:57.260862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:57.260862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:57.263273 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:57.458743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:57.469315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3324770e-6ecd-4226-9fcd-919cb08c414a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.241485 Sep 11 00:02:57.469997 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 143/274] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:57 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:58.493718 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:58.494328 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:58.500245 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:58.500726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:58.501193 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:58.501888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:58.502311 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:58.502780 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:58.676233 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:58.685236 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e8985fd8-858c-44e0-a71a-24b9ab15b0de tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.196626 Sep 11 00:02:58.699077 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 132/275] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:58 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:02:59.710037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:02:59.710741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:02:59.717606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:59.718445 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:59.719645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:59.720389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:02:59.721208 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:02:59.721566 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:02:59.923733 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:02:59.933478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b53eb733-9717-45ac-b2ce-e77582dfdee8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.227935 Sep 11 00:02:59.934591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 144/276] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:02:59 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:00.958534 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:00.960821 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:00.967275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:00.967762 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:00.968232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:00.968966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:00.969550 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:00.969979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:01.135012 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:01.142682 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dda8750d-1d3a-46fe-8ca7-0404c2d8cba9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.188851 Sep 11 00:03:01.143258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 133/277] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:00 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:02.166978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:02.167588 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:02.173825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:02.174323 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:02.174842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:02.175699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:02.176347 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:02.177017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:02.180261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:02.320620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:02.328720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4d115484-4353-4a4d-baef-7b8e9e214c1c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.165766 Sep 11 00:03:02.329292 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 145/278] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:02 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:03.353428 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:03.354196 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:03.357849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=24 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:03.361482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:03.361964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:03.362394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:03.363792 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:03.364255 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:03.364870 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:03.556177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:03.566883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f27c126b-2bc1-4b4b-9585-4f795bd206f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.217035 Sep 11 00:03:03.567698 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 134/279] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:03 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:04.598253 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:04.599354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:04.606444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:04.606955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:04.607384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:04.608092 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:04.608534 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:04.608946 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:04.776307 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:04.785106 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ca8c666c-0b1c-416c-95ab-4074c3ec546f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.195271 Sep 11 00:03:04.785735 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 146/280] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:04 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:04.999238 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:05.001226 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:05.007245 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:05.007728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:05.008196 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:05.008906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:05.009386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:05.009809 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:05.040852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b4e6ce6f-55fc-4aa5-8696-7fc1783cab4e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/ips" status: 200 len: 145 microversion: 2.1 time: 0.047348 Sep 11 00:03:05.040852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 135/281] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:03:04 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:03:05.784235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:05.784235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:05.788641 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:05.789116 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:05.789541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:05.790217 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:05.790677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:05.791095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:05.811516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:05.813283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:05.817118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3683f3f6-25f9-464a-9092-981b683b5a27 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/ips" status: 200 len: 151 microversion: 2.20 time: 0.038134 Sep 11 00:03:05.825689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 147/282] 10.222.0.17 () {60 vars in 1289 bytes} [Sun Sep 11 00:03:05 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:03:05.830800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:05.833958 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:05.834859 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:05.836605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:05.837478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:05.839946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:06.025593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:06.033839 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9f05c99a-0c62-4483-b455-28717bd18ccc tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.227350 Sep 11 00:03:06.034483 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 136/283] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:05 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:07.057872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:07.058573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:07.064718 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:07.065201 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:07.065638 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:07.067059 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:07.067728 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:07.068409 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:07.227834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:07.235589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a7c3a118-1753-48a1-9892-386f095992a0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.181805 Sep 11 00:03:07.236218 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 148/284] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:07 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:08.259428 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:08.260150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:08.268052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:08.272239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:08.272239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:08.272239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:08.272239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:08.272584 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:08.433252 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:08.443877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dabde2b7-22f3-43dc-b7b1-2efe26175575 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.187283 Sep 11 00:03:08.444479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 137/285] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:08 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:09.031376 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:09.032003 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:09.038635 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:09.039242 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:09.039764 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:09.040448 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:09.040954 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:09.041549 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:09.067400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lazy-loading 'flavor' on Instance uuid b206b090-4c06-4bf1-a005-379f4056da27 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:03:09.466451 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5e461d8-ee33-4d4e-a41e-9eb769bebf37"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:09.468797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:09.475131 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:09.475610 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:09.476045 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:09.476725 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:09.477173 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:09.477595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:09.616909 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-167da5f3-ebe0-4320-9862-4922b9e4b3ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/action" status: 202 len: 0 microversion: 2.20 time: 0.589357 Sep 11 00:03:09.617503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 149/286] 10.222.0.17 () {62 vars in 1319 bytes} [Sun Sep 11 00:03:09 2022] POST /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:03:09.622707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:09.623527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:09.629787 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:09.630336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:09.634792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:09.634792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:09.634792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:09.634792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:09.766645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:09.775514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-abe4e623-4dbb-4830-922a-08e4dbacf4e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.156860 Sep 11 00:03:09.778375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 150/287] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:09 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:09.780871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:09.781612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:09.791668 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:09.792154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:09.792589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:09.793288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:09.793769 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:09.794191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:09.933831 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:09.943238 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:09.944767 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:09.945842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-664ef383-578a-454a-9ead-54ffa8c5f055 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.168835 Sep 11 00:03:09.946387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 151/288] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:09 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:10.346883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1477159e-49f2-483a-856f-158203052692 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883599 Sep 11 00:03:10.347585 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 138/289] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:03:09 2022] POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:03:10.801175 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:10.802132 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:10.808207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:10.808707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:10.809139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:10.809835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:10.810359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:10.810722 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:10.976218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:10.976922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:10.984306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:10.984947 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:10.990928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:10.990928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:10.990928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:10.990928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:11.025397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:11.038394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-444cdf73-f2e4-42e3-aa1c-8e1d46fe38b8 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.241069 Sep 11 00:03:11.039560 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 152/290] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:10 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:11.158891 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:11.170344 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:11.171759 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:11.172966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1d654467-cc10-4268-8ebe-fc0536ea3257 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.203097 Sep 11 00:03:11.174047 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 139/291] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:10 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:12.062803 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:12.063503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:12.079691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:12.080174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:12.080598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:12.081315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:12.081756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:12.082343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:12.198781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:12.202358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:12.209845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:12.210425 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:12.210970 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:12.211671 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:12.212407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:12.212833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:12.251588 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:12.259818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-79946ef8-e856-41dd-a198-64eed2233e88 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.201794 Sep 11 00:03:12.268015 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 153/292] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:12 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:12.349326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:12.357216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:12.358634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:12.359798 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-92eaf683-a98d-4fe7-ab1f-6bd0d9df580e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.164936 Sep 11 00:03:12.360405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 140/293] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:12 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:13.288674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:13.288674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:13.293890 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:13.294376 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:13.294844 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:13.295800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:13.296578 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:13.296700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:13.384846 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:13.385462 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:13.391945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:13.392433 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:13.392868 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:13.393552 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:13.394165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:13.394770 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:13.432163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:13.441037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-812974a9-5e0e-408d-a4f2-2282d6519959 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.158610 Sep 11 00:03:13.441484 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 154/294] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:13 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:13.545201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:13.553505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:13.554958 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:13.556189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-52a297a8-7aa9-457b-ba90-1bff86abb3cd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.175213 Sep 11 00:03:13.556988 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 141/295] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:13 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:14.467770 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:14.468627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:14.476999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:14.477485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:14.477921 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:14.478619 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:14.480202 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:14.480634 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:14.592095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:14.592700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:14.602345 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:14.604116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:14.604630 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:14.606167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:14.606621 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:14.607977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:14.641019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:14.650316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-99f2a468-15cb-4a61-be20-dcf342f814a1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.189179 Sep 11 00:03:14.651218 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 155/296] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:14 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:14.765995 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:14.775078 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:14.776570 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:14.777712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e0ba4707-2784-48ab-9e3b-6f1f4e4a1d98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.189653 Sep 11 00:03:14.778268 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 142/297] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:14 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:15.677396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:15.678643 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:15.684599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:15.685134 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:15.685569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:15.686246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:15.686700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:15.687118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:15.805198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:15.806561 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:15.814754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:15.816294 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:15.816905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:15.817771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:15.818682 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:15.823149 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:15.823149 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:15.852331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:15.862889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a2b332fb-60be-4e2e-9c46-bf5086061128 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.186683 Sep 11 00:03:15.863491 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 156/298] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:15 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:16.003282 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:16.015021 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:16.016118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:16.017265 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a704f869-662d-4ebe-a991-cf7a8cf714a5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.216842 Sep 11 00:03:16.017978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 143/299] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:15 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:16.888790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:16.889487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:16.895443 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:16.895914 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:16.896412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:16.897154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:16.897598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:16.898342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:17.044022 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:17.044742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:17.054512 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:17.055202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:17.056760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:17.057365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:17.057957 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:17.058654 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:17.076857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:17.085507 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-245dddbb-172a-4970-9ec5-f616ecf00325 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.200553 Sep 11 00:03:17.086554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 157/300] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:16 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:17.213724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:17.221957 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:17.223733 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:17.224895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2113a3e6-60cb-42ee-b4c3-e27a1db8c6e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.184701 Sep 11 00:03:17.225446 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 144/301] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:17 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:18.112258 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:18.113571 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:18.121539 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:18.122365 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:18.122829 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:18.123747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:18.124197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:18.124807 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:18.250777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:18.255320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:18.258416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:18.258924 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:18.259360 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:18.260057 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:18.260509 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:18.260932 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:18.261160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:18.268801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cfe43b1e-18c7-4951-96f6-4324de4af71b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.161655 Sep 11 00:03:18.269396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 158/302] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:18 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:18.414646 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:18.421614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:18.423077 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:18.424239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d90dd3d5-76e9-4596-9a00-7dfab7987578 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.177474 Sep 11 00:03:18.424836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 145/303] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:18 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:19.293889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:19.295552 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:19.304690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:19.305730 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:19.306816 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:19.308174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:19.308630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:19.309080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:19.452141 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:19.453299 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:19.453887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:19.461867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:19.462340 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-83264656-d583-480c-a17b-8cac9c4cc666 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.173746 Sep 11 00:03:19.462736 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:19.462951 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 159/304] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:19 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:19.463726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:19.464625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:19.465076 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:19.465496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:19.572591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1bbea4cb-cf15-4708-9226-3f12f790def4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:19.578887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bbea4cb-cf15-4708-9226-3f12f790def4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:19.579375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bbea4cb-cf15-4708-9226-3f12f790def4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:19.579811 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bbea4cb-cf15-4708-9226-3f12f790def4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:19.609071 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:19.617971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:19.619487 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:19.620714 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-09da479b-051c-4bf2-bf10-8effcd137f87 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.172988 Sep 11 00:03:19.621279 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 146/305] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:19 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:19.625803 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:19.661368 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1bbea4cb-cf15-4708-9226-3f12f790def4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Going to try to stop instance {{(pid=121067) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 00:03:19.915853 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1bbea4cb-cf15-4708-9226-3f12f790def4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/action" status: 202 len: 0 microversion: 2.1 time: 0.347395 Sep 11 00:03:19.916447 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 160/306] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:03:19 2022] POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:03:19.924765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:19.925364 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:19.931749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:19.932326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:19.932815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:19.933559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:19.934005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:19.934420 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.093504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:20.103305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7a27acef-869f-4719-b35a-608c851c5a94 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.182358 Sep 11 00:03:20.103952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 147/307] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:19 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:20.486105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:20.486887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:20.493784 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:20.494271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:20.494730 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.495426 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:20.495880 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:20.496303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.631309 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:20.641639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-84d92619-767f-4d41-a968-744d78255a89 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1501 microversion: 2.1 time: 0.159708 Sep 11 00:03:20.642314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 161/308] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:20 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:20.646807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:20.647412 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:20.654724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:20.655200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:20.655791 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.656662 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:20.657535 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:20.657959 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.667611 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d77eb687-e736-47cf-b8f8-5feb606d0d55"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:20.672008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:20.678993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:20.679485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:20.680160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.680999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:20.681458 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:20.681896 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.712325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] HTTP exception thrown: Cannot 'attach_volume' instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 while it is in vm_state rescued Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Request method failure captured: Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: POST /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289/os-volume_attachments HTTP/1.1 Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 74 Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVFGZAiyc7PEdHjnPTpZKE5_yItwy5vPJHcwOPgr5_CjblTSvJNtfk4L2GFcbhaf7T50zcH-bmVBQ7tER7-WwV0lDH4ju7hO0sOUPUYkSld0V4_GqymUN6XoGtdnxK-4hbpYd6s8bSl8h0NMkvxI2kuILXo4ydne9C-3jhQm-3MLV0 Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:03:20.714071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0b35b1c14ba4a2e9b23a223628b449c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}] Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: b8ceeb13c4c24ceb9ff1f27b4e45f62c Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {"volumeAttachment": {"volumeId": "d77eb687-e736-47cf-b8f8-5feb606d0d55"}} Sep 11 00:03:20.715738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Cannot 'attach_volume' instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 while it is in vm_state rescued Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'server_id': '6501cde1-0dad-4b77-a8d3-39cc6b8ef289', 'body': {'volumeAttachment': {'volumeId': 'd77eb687-e736-47cf-b8f8-5feb606d0d55'}}} Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:03:20.716508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 while it is in vm_state rescued Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:03:20.717761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:03:20.718965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:03:20.718965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:03:20.718965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 while it is in vm_state rescued Sep 11 00:03:20.718965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:03:20.718965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Returning 409 to user: Cannot 'attach_volume' instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 while it is in vm_state rescued {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:03:20.718965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2927df47-e761-48a9-b353-a3940b978d58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053308 Sep 11 00:03:20.718965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 162/309] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:03:20 2022] POST /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 00:03:20.725168 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:20.727008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:20.733478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:20.734423 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:20.735109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.735806 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:20.736422 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:20.736846 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:20.845197 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:20.856017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:20.858800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:20.860395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d362f29b-a046-4fa5-bb6f-008118208ef5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.217538 Sep 11 00:03:20.861100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 148/310] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:20 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:21.002835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f54cae72-a095-48bc-be03-116b1f1d08bb tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289/action" status: 202 len: 0 microversion: 2.1 time: 0.282004 Sep 11 00:03:21.006523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 163/311] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:03:20 2022] POST /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:03:21.012505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:21.013122 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:21.020104 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:21.025940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:21.025940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:21.025940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:21.025940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:21.026538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:21.129949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:21.131134 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:21.138095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:21.139663 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:21.139663 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:21.140121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:21.141071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:21.141501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:21.384888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:21.400775 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9b968448-8fa9-41ef-8698-3dd6d357e52d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1509 microversion: 2.1 time: 0.392018 Sep 11 00:03:21.401452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 149/312] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:21 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1509 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:21.418871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:21.434736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3981750d-8f2a-47ca-b585-dc04cdbec85e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.309141 Sep 11 00:03:21.438760 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 164/313] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:21 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:21.888166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:21.888929 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:21.896380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:21.896875 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:21.897310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:21.898596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:21.899160 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:21.899681 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:22.088487 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:22.106341 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:22.108790 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:22.110130 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8e9d8547-f9b8-4a1d-9e30-9dc052676947 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.228656 Sep 11 00:03:22.111387 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 150/314] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:21 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:22.428742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:22.431491 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:22.438242 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:22.438945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:22.439627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:22.440652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:22.441541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:22.442402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:22.464930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:22.466083 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:22.478547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:22.479150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:22.479594 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:22.480314 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:22.480772 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:22.481194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:22.649149 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:22.661068 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-92532b1f-7843-4911-bf96-e37da796a352 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.202788 Sep 11 00:03:22.669605 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:22.675332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 151/315] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:22 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:22.686121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-77ee6027-ca1b-488e-a115-a1fdb522e3b1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1509 microversion: 2.1 time: 0.259160 Sep 11 00:03:22.686121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 165/316] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:22 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:23.143834 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:23.144449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:23.151474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:23.151969 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:23.152416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:23.153121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:23.153570 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:23.153993 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:23.342439 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:23.352079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:23.353676 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:23.354876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7034af12-dd52-42a1-8743-ed20ebc9db7a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.214983 Sep 11 00:03:23.355431 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 152/317] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:23 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:23.686294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:23.687044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:23.692963 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:23.699400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:23.699400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:23.699400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:23.699400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:23.699924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:23.708779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:23.709553 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:23.716720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:23.717658 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:23.718340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:23.719483 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:23.720147 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:23.720777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:23.850366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:23.860656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-45f4e5a7-49a0-4f07-b835-f387b73bd9f0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.178089 Sep 11 00:03:23.861231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 166/318] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:23 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:23.897786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:23.906908 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c8f06bb5-4892-4758-b76a-b3bacc66f396 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1509 microversion: 2.1 time: 0.202164 Sep 11 00:03:23.914798 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 153/319] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:23 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:24.382942 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:24.383564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:24.389445 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:24.389924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:24.390349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:24.391054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:24.391497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:24.391911 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:24.547214 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:24.555403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:24.556856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:24.558015 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-da9af8c4-88ca-4819-ab96-97e312f36932 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.180943 Sep 11 00:03:24.558554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 167/320] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:24 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:24.885148 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:24.886137 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:24.892743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:24.893317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:24.893944 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:24.894846 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:24.895283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:24.896005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:24.932356 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:24.934853 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:24.940066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:24.940540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:24.941268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:24.942048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:24.942574 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:24.943342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:25.050779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:25.060742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7ff6c7f2-144a-452e-a837-037d2569f2c1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.180060 Sep 11 00:03:25.078311 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 154/321] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:24 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:25.153199 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:25.161617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-dcce9f63-7586-4a39-9c69-b4d2931b5333 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1509 microversion: 2.1 time: 0.234956 Sep 11 00:03:25.162216 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 168/322] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:24 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:25.587196 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:25.587809 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:25.594920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:25.595400 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:25.595838 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:25.596544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:25.596994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:25.598888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:25.775324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:25.785085 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:25.787647 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:25.789696 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f7bec63a-0049-4ab4-8473-6b3103129b43 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.205948 Sep 11 00:03:25.790263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 155/323] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:25 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:26.085482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:26.086132 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:26.092352 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:26.092835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:26.093272 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:26.093960 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:26.094411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:26.094870 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:26.186936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:26.188415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:26.196634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:26.197445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:26.198091 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:26.199012 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:26.200307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:26.201120 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:26.245740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:26.255528 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8cfc36f5-ef04-4999-9ba9-775e66d91092 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.173913 Sep 11 00:03:26.256072 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 169/324] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:26 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:26.362092 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:26.370704 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d1973a57-73af-4682-bbe5-cd90a7e12c6a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1509 microversion: 2.1 time: 0.188212 Sep 11 00:03:26.371275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 156/325] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:26 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:26.826184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:26.826814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:26.839290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:26.839981 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:26.840569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:26.841331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:26.841949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:26.842690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:26.999435 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:27.014226 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:27.015719 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:27.016888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-adee86e2-9817-4981-8bb0-5c62d704cb65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.195008 Sep 11 00:03:27.017440 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 170/326] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:26 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:27.283712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:27.284316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:27.290883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:27.291372 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:27.291798 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:27.292471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:27.292915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:27.293324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:27.394551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:27.395989 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:27.399540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=56 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:27.403113 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:27.403685 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:27.404104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:27.404808 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:27.405261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:27.405714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:27.431964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:27.441813 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-99679741-babb-4eb7-811e-669669d5646a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.161867 Sep 11 00:03:27.455492 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 157/327] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:27 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:27.550239 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:27.558452 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4986b779-956c-42d1-9668-47a4ffb4bdbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1515 microversion: 2.1 time: 0.167813 Sep 11 00:03:27.559073 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 171/328] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:27 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:28.047858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:28.048460 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:28.054255 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:28.054853 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:28.055307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:28.056869 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:28.056869 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:28.056869 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:28.197064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:28.205515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:28.206998 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:28.208384 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-01b69325-01db-4006-9514-fed406e68549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1743 microversion: 2.20 time: 0.164424 Sep 11 00:03:28.209239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 158/329] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:28 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:28.467807 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:28.468462 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:28.474559 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:28.475125 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:28.475616 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:28.480444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:28.480444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:28.480444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:28.606848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:28.615499 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8ce15561-2822-4d4d-b17a-670b62be461c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.151801 Sep 11 00:03:28.616065 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 172/330] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:28 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:29.238109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:29.239866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:29.247376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:29.248474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:29.249455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:29.250680 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:29.251458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:29.251897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:29.255096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5ef8912f-252d-4793-b64b-9e1352bec90d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'create', calling method: .version_select at 0x7f5ab6b73b80>, body: {"keypair": {"name": "tempest-keypair-862996622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwaFLfokUD3oWD+bfdCiEWPvKkMGwoOVdPw+FGoy3mP+TgMPHPmy4Sw99EMGrgYbu+EfjySmraTn8XUSynGdq1gZhqdcHfenYzAaJoVqH1sU0iisCbikr6HyXA7SimNug=="}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:29.271348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-5ef8912f-252d-4793-b64b-9e1352bec90d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Getting quotas for project b0b35b1c14ba4a2e9b23a223628b449c. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:03:29.275541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-5ef8912f-252d-4793-b64b-9e1352bec90d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Getting quotas for user b8ceeb13c4c24ceb9ff1f27b4e45f62c and project b0b35b1c14ba4a2e9b23a223628b449c. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:03:29.366150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5ef8912f-252d-4793-b64b-9e1352bec90d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115057 Sep 11 00:03:29.366894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 173/331] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:03:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:03:29.377424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-68513774", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "networks": [{"uuid": "5e125d53-b157-4cfc-b72d-e9f0403df098"}]}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:29.389743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:29.392159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:29.399794 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:29.401172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:29.402492 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-79f03593-9b51-47eb-8215-f5d3d8ba621b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1743 microversion: 2.20 time: 0.168934 Sep 11 00:03:29.403066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 159/332] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:29 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:29.437119 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] validate_networks() for [('5e125d53-b157-4cfc-b72d-e9f0403df098', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:03:29.640522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:29.641401 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:29.648260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:29.649015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:29.649454 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:29.650156 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:29.650605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:29.651052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:29.820764 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:29.829920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dbf55ea2-0f32-4562-a006-c907d4ba580c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.193970 Sep 11 00:03:29.833466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 160/333] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:29 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:29.935533 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:03:29.935996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:03:29.936401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:03:29.936824 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:03:29.937246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:03:29.949654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:29.950133 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:29.950565 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:29.951319 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:29.951765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:29.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:29.971687 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Getting quotas for project fa03f6136eb640ad803659779ce1b085. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:03:29.976974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Getting quotas for user 017684196c8e49e0894d38daf83bfaeb and project fa03f6136eb640ad803659779ce1b085. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:03:29.990748 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:03:29.994652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:03:30.132098 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0b827d81-5560-4971-86eb-ceeb32f130d8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758072 Sep 11 00:03:30.132938 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 174/334] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:03:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:03:30.144295 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0cabac1d-b404-428c-97aa-cb5b097fef16 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:30.144973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0cabac1d-b404-428c-97aa-cb5b097fef16 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:30.232916 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0cabac1d-b404-428c-97aa-cb5b097fef16 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:30.242468 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0cabac1d-b404-428c-97aa-cb5b097fef16 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1217 microversion: 2.1 time: 0.101207 Sep 11 00:03:30.245230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 161/335] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:30 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:30.430027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:30.430574 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:30.437398 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:30.437845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:30.438271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:30.439062 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:30.439505 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:30.439921 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:30.576724 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:30.585045 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:30.589008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:30.589008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c397bc53-93d0-40eb-b1f8-ee80e58a4a6e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1743 microversion: 2.20 time: 0.162992 Sep 11 00:03:30.589008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 175/336] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:30 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:30.854474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:30.855119 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:30.862483 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:30.863078 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:30.863586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:30.864461 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:30.865123 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:30.865542 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:31.064152 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:31.073940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6fa51591-42c3-4a51-8578-abaed7cadbf3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.224200 Sep 11 00:03:31.074516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 162/337] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:30 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:31.267301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-839d2054-2c94-42b3-8085-267b77959930 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:31.267928 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-839d2054-2c94-42b3-8085-267b77959930 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:31.323981 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-839d2054-2c94-42b3-8085-267b77959930 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:31.331418 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-839d2054-2c94-42b3-8085-267b77959930 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1217 microversion: 2.1 time: 0.067827 Sep 11 00:03:31.332188 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 176/338] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:31 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:31.621032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:31.622185 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:31.622673 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-75da94bd-43f2-49a4-a9a8-ca8790562902 req-39406eda-7221-47b9-866c-36656bdb0e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b206b090-4c06-4bf1-a005-379f4056da27", "name": "network-vif-plugged", "status": "completed", "tag": "13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:31.636752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-75da94bd-43f2-49a4-a9a8-ca8790562902 req-39406eda-7221-47b9-866c-36656bdb0e14 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:31.637330 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-75da94bd-43f2-49a4-a9a8-ca8790562902 req-39406eda-7221-47b9-866c-36656bdb0e14 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:31.638032 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-75da94bd-43f2-49a4-a9a8-ca8790562902 req-39406eda-7221-47b9-866c-36656bdb0e14 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:31.640701 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:31.641192 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:31.646885 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:31.648235 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:31.648706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:31.649357 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:31.652479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-75da94bd-43f2-49a4-a9a8-ca8790562902 req-39406eda-7221-47b9-866c-36656bdb0e14 service nova] Creating event network-vif-plugged:13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1 for instance b206b090-4c06-4bf1-a005-379f4056da27 on hv-cinder-85200 Sep 11 00:03:31.660361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-75da94bd-43f2-49a4-a9a8-ca8790562902 req-39406eda-7221-47b9-866c-36656bdb0e14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043962 Sep 11 00:03:31.660969 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 177/339] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:03:31.847605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:31.857335 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:31.859200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:31.865267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-cd2d45de-2192-46ae-aa77-e44d37e4ba17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1743 microversion: 2.20 time: 0.248657 Sep 11 00:03:31.865267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 163/340] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:31 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:32.100637 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:32.101421 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:32.113957 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:32.114444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:32.115497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:32.119387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:32.119857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:32.120657 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:32.141309 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:32.258880 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1389541169", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83085c38-54ce-4ec2-9f1f-78c3aabf2ddd"}], "security_groups": [{"name": "tempest-securitygroup--776849689"}], "key_name": "tempest-keypair-862996622", "user_data": "}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:32.310048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:32.333733 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6feb3820-19b4-4adb-a707-5792a8ad827a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.237465 Sep 11 00:03:32.338279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 178/341] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:32 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:32.357740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:32.358474 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:32.366040 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:32.367336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:32.367829 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:32.368568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:32.369020 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:32.369474 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:32.467793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:32.482098 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8526d2b3-333e-4889-b426-9639bc856126 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1269 microversion: 2.1 time: 0.130336 Sep 11 00:03:32.486481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] validate_networks() for [('83085c38-54ce-4ec2-9f1f-78c3aabf2ddd', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:03:32.486832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 179/342] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:32 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1269 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:32.889762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:32.892808 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:32.912032 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:32.913066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:32.913648 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:32.914685 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:32.915154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:32.915570 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:33.082192 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:03:33.083227 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:03:33.083961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:03:33.084525 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:03:33.085943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:03:33.096855 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:33.097326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:33.097755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:33.098468 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:33.098967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:33.099545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:33.119165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Getting quotas for project b0b35b1c14ba4a2e9b23a223628b449c. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:03:33.122154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:33.124324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Getting quotas for user b8ceeb13c4c24ceb9ff1f27b4e45f62c and project b0b35b1c14ba4a2e9b23a223628b449c. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:03:33.134143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:33.135868 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:33.137196 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4d8e5045-96ba-4f59-b5a1-9303b66dfdae tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.252846 Sep 11 00:03:33.138600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:03:33.141340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:03:33.152067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 180/343] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:32 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:33.331353 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f1f7ff2a-1c93-4eea-8da9-ceef1f61019a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.078836 Sep 11 00:03:33.332109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 164/344] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:03:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:03:33.344568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-35a1cd35-d719-42bf-96aa-6da06c62566c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:33.345883 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-35a1cd35-d719-42bf-96aa-6da06c62566c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:33.380946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:33.389106 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:33.410989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:33.411784 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:33.412215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:33.413437 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:33.413900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:33.414354 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:33.454247 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-35a1cd35-d719-42bf-96aa-6da06c62566c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:33.473295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-35a1cd35-d719-42bf-96aa-6da06c62566c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1245 microversion: 2.1 time: 0.132788 Sep 11 00:03:33.473877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 181/345] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:33 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1245 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:33.508557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:33.509412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:33.544670 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:33.545511 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:33.547075 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:33.548054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:33.551654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:33.552294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:33.684429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:33.695850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-660b317b-0079-4f89-97cc-dc56d05d617c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.330907 Sep 11 00:03:33.706077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:33.714995 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 165/346] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:33 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:33.718235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ba47e694-6194-4327-93b9-25aa1d9f81dd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1277 microversion: 2.1 time: 0.213790 Sep 11 00:03:33.720428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 182/347] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:33 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:34.170083 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:34.171416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:34.173475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:34.182385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:34.185793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:34.191187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:34.191187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:34.191187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:34.191187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:34.479938 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:34.496085 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:34.496085 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:34.496479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bdc61766-149f-4a63-93dd-ef669a059557 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.330121 Sep 11 00:03:34.521725 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5b7e39b6-368f-4ec5-b94d-cf5d38736225 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:34.524403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5b7e39b6-368f-4ec5-b94d-cf5d38736225 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:34.530319 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 166/348] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:34 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:34.602422 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5b7e39b6-368f-4ec5-b94d-cf5d38736225 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:34.609959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5b7e39b6-368f-4ec5-b94d-cf5d38736225 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1245 microversion: 2.1 time: 0.097332 Sep 11 00:03:34.610527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 183/349] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:34 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:34.721200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:34.722192 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:34.729873 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:34.730819 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:34.731572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:34.733198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:34.734079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:34.735020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:34.748139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:34.749346 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:34.761042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:34.764867 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:34.765587 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:34.766526 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:34.767254 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:34.767910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:34.985620 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:34.994269 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1bded104-b0a9-4e87-a072-02023a60dac9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.276836 Sep 11 00:03:34.995473 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 167/350] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:34 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:35.092498 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:35.100771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a8b783cd-f487-4670-98ae-818a18bccdf9 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.356779 Sep 11 00:03:35.101945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 184/351] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:34 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:35.534544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:35.536003 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:35.542877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:35.543430 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:35.543930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:35.544699 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:35.545136 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:35.545549 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:35.639537 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:35.640456 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:35.648647 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:35.649447 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:35.650077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:35.651437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:35.652259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:35.653271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:35.701485 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:35.720874 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:35.722480 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:35.723696 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dea82401-1313-41ca-9a24-8a16768bea65 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.199802 Sep 11 00:03:35.727775 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 168/352] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:35 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:35.747756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:35.763012 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5b6352ca-423e-4084-821b-f9f261e31c55 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1249 microversion: 2.1 time: 0.127146 Sep 11 00:03:35.764088 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 185/353] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:35 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1249 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:36.018511 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:36.019724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:36.030731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:36.031696 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:36.032321 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:36.033216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:36.033863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:36.034488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:36.183268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:36.184419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:36.192811 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:36.195510 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:36.198485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:36.199522 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:36.200224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:36.200882 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:36.261914 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:36.273394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6cf2a262-bbcb-4d12-8d10-3fdf9c27ad19 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.258363 Sep 11 00:03:36.279872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 169/354] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:36 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:36.419083 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:36.427836 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c75ebf99-90f4-4605-a7d5-e1c5d955fc33 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.306112 Sep 11 00:03:36.429314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 186/355] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:36 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:36.762805 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:36.763421 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:36.769922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:36.770404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:36.770868 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:36.771565 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:36.772017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:36.772820 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:36.789661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:36.790976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:36.797437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:36.797921 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:36.798360 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:36.799074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:36.799751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:36.800326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:36.866636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:36.875004 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f006d80f-4f78-4be2-965e-6b84c5ab0c49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1249 microversion: 2.1 time: 0.089051 Sep 11 00:03:36.886838 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 187/356] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:36 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:36.912351 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:36.920830 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:36.922310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:36.929888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-980e4d79-89a6-4895-8abe-bd1fe7d8a98e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.164764 Sep 11 00:03:36.929888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 170/357] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:36 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:37.300513 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:37.301480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:37.318336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:37.319612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:37.320796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:37.321887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:37.322353 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:37.322797 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:37.451708 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:37.452040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:37.468674 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:37.469405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:37.470012 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:37.470931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:37.471557 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:37.472274 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:37.707694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:37.721172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3a92717a-53a6-46ae-a115-0ec2e155f133 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.273584 Sep 11 00:03:37.731079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 171/358] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:37 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:37.731294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:37.734833 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-83538167-9a78-4f3c-9749-b67dd8d3697e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.440340 Sep 11 00:03:37.743561 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 188/359] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:37 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:37.905459 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:37.906571 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:37.914854 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:37.915806 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:37.916436 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:37.917310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:37.917904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:37.918474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:37.953558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:37.954810 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:37.964737 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:37.970835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:37.971577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:37.976185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:37.976185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:37.976185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:38.026810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:38.040032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-41610ad1-9a2d-4bc5-8948-663b2b1e6c73 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1297 microversion: 2.1 time: 0.143544 Sep 11 00:03:38.051301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 172/360] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:37 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1297 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:38.536376 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:38.545946 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:38.557170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:38.560348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1fb5f7c1-2fab-4b21-ad14-139e4b313bb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.609155 Sep 11 00:03:38.574302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 189/361] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:37 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:38.747694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:38.748208 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:38.761510 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:38.762583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:38.765832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:38.766956 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:38.767614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:38.773796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:38.773796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:38.773796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:38.773796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:38.774340 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:38.774596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:38.783570 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:38.786637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:38.787389 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:38.995116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:39.005800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0c59bcc8-bc1f-41b6-b861-85e0c5ef65d4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.261770 Sep 11 00:03:39.007527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 173/362] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:38 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:39.013107 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-a78da372-0ba0-49f2-ab3f-249f9cd34d45 req-73085264-585f-43d0-a01c-20ce295c93f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d5a6b91-ea62-4218-b010-549ce18c06fe", "tag": "d6355983-d4da-4770-b3cb-d3be0b42bd62"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:39.013702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:39.022923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-84b70232-3eb1-4648-b950-1efd4a53ca31 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.265893 Sep 11 00:03:39.027738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-a78da372-0ba0-49f2-ab3f-249f9cd34d45 req-73085264-585f-43d0-a01c-20ce295c93f9 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:39.030516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-a78da372-0ba0-49f2-ab3f-249f9cd34d45 req-73085264-585f-43d0-a01c-20ce295c93f9 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:39.030811 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 190/363] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:38 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:39.030940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-a78da372-0ba0-49f2-ab3f-249f9cd34d45 req-73085264-585f-43d0-a01c-20ce295c93f9 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:39.046056 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-a78da372-0ba0-49f2-ab3f-249f9cd34d45 req-73085264-585f-43d0-a01c-20ce295c93f9 service nova] Creating event network-changed:d6355983-d4da-4770-b3cb-d3be0b42bd62 for instance 6d5a6b91-ea62-4218-b010-549ce18c06fe on hv-cinder-85200 Sep 11 00:03:39.051860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-a78da372-0ba0-49f2-ab3f-249f9cd34d45 req-73085264-585f-43d0-a01c-20ce295c93f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042706 Sep 11 00:03:39.057385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 174/364] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:03:39.062549 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:39.063200 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:39.069715 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:39.070363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:39.095181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:39.097289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:39.097996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:39.098523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:39.337845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:39.352886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-47ec4fe5-de21-4c93-ba3b-e131c4d055da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1305 microversion: 2.1 time: 0.290453 Sep 11 00:03:39.359492 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 191/365] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:39 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1305 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:39.592170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:39.593863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:39.603325 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:39.604352 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:39.605117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:39.606160 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:39.606939 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:39.607640 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:39.911930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:39.927260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:39.929969 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:39.931913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3517b33f-b6fe-41cf-b44c-503e7ecd32c7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.346647 Sep 11 00:03:39.933266 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 175/366] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:39 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:40.034182 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:40.035449 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:40.041968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:40.052245 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:40.054085 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:40.058279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:40.063979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:40.070653 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:40.070653 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:40.070653 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:40.070653 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:40.072362 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:40.074849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:40.078700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:40.079470 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:40.079934 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:40.080346 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:40.359385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:40.371267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e24da1fc-5e51-49a6-9275-602695521ea0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1722 microversion: 2.1 time: 0.323145 Sep 11 00:03:40.373149 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 176/367] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:40 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:40.379478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:40.380539 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:40.389595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:40.390614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:40.394361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:40.400498 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:40.401078 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:40.401638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:40.476875 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:40.492314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:40.495018 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ff881f9a-0880-4881-a4e3-d40d40ca5404 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1303 microversion: 2.1 time: 0.116644 Sep 11 00:03:40.500129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 177/368] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:40 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:40.528929 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-446c38d2-3e98-4ff9-bf67-91411f6da8b2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.498128 Sep 11 00:03:40.531129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 192/369] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:40 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:40.961670 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:40.963670 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:40.974537 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:40.976037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:40.976743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:40.982200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:40.983003 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:40.983612 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:41.246191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:41.255040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:41.257515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:41.260076 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:41.261478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2c0f1435-cfdc-4a90-9761-e147f04aced6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.305319 Sep 11 00:03:41.262566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 178/370] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:40 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:41.403768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:41.404455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:41.415086 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:41.415835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:41.417556 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:41.419209 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:41.419847 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:41.420432 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:41.531319 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:41.531319 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:41.542137 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:41.542580 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:41.543049 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:41.544961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:41.546114 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:41.550705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:41.758308 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:41.786928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c7309b8a-014a-4419-9a45-2f30552a7be1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.242283 Sep 11 00:03:41.786928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 179/371] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:41 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:41.786928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:41.786928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:41.814804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:41.815228 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:41.816291 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:41.816419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:41.816823 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:41.817271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:41.974894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:41.988372 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-14191322-1cc9-431a-8f35-a6a85755c7b7 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1699 microversion: 2.1 time: 0.593254 Sep 11 00:03:41.989307 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 193/372] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:41 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1699 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:42.018473 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b4b22be5-77ba-497f-a526-80357b78f94e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:42.025253 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4b22be5-77ba-497f-a526-80357b78f94e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:42.026116 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4b22be5-77ba-497f-a526-80357b78f94e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:42.026547 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b4b22be5-77ba-497f-a526-80357b78f94e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:42.028222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:42.038253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-53058324-d6f8-4378-9f0c-ad55376be15b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.268859 Sep 11 00:03:42.039366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 180/373] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:41 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:42.057195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b4b22be5-77ba-497f-a526-80357b78f94e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Going to try to start instance {{(pid=121067) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 00:03:42.290757 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:42.291364 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:42.297618 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:42.298103 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:42.298537 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:42.299258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:42.299705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:42.300127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:42.434241 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:42.442084 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:42.443954 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:42.445153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6d1afdcf-14a4-4d13-8a52-61a5c70a7209 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.158448 Sep 11 00:03:42.445797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 181/374] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:42 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:42.487358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b4b22be5-77ba-497f-a526-80357b78f94e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/action" status: 202 len: 0 microversion: 2.1 time: 0.471452 Sep 11 00:03:42.489405 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 194/375] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:03:42 2022] POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:03:42.510992 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:42.512047 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:42.525444 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:42.526322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:42.526941 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:42.538067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:42.538903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:42.540376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:42.806387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:42.807535 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:42.818043 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:42.820132 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:42.822714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:42.828066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:42.831079 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:42.831738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:42.851444 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:42.860757 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-237eb1be-0a37-4a10-88b6-c94c82017126 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1708 microversion: 2.1 time: 0.367178 Sep 11 00:03:42.862220 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 182/376] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:42 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1708 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:43.062034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:43.062730 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:43.076332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:43.076836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:43.077277 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:43.077991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:43.078443 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:43.082797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:43.109441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:43.173358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=8 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:43.389606 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:43.400308 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b1fc7f60-dba4-42dc-aa6e-4e2e553c80a3 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.342245 Sep 11 00:03:43.417060 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 183/377] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:43 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:43.442390 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-ffb043e7-b496-4ad9-ab4c-3c6b49c0a3c7 req-58c0f1f9-77af-421a-a540-dd63133919af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65cfc71-51a9-461d-a845-b46e71080e92", "tag": "d1ad97b5-d674-4dfa-b8e0-dd3bb492e819"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:43.442505 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:43.456488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-51649dd7-6965-4aa1-a7b3-43dacd85f10e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.655547 Sep 11 00:03:43.458427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 195/378] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:42 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:43.458736 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ffb043e7-b496-4ad9-ab4c-3c6b49c0a3c7 req-58c0f1f9-77af-421a-a540-dd63133919af service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:43.460516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ffb043e7-b496-4ad9-ab4c-3c6b49c0a3c7 req-58c0f1f9-77af-421a-a540-dd63133919af service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:43.461246 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ffb043e7-b496-4ad9-ab4c-3c6b49c0a3c7 req-58c0f1f9-77af-421a-a540-dd63133919af service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:43.478168 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:43.479466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:43.491302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:43.493042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:43.494489 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:43.496012 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:43.499949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:43.505316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:43.512052 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:43.517196 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-ffb043e7-b496-4ad9-ab4c-3c6b49c0a3c7 req-58c0f1f9-77af-421a-a540-dd63133919af service nova] Creating event network-changed:d1ad97b5-d674-4dfa-b8e0-dd3bb492e819 for instance c65cfc71-51a9-461d-a845-b46e71080e92 on hv-cinder-85200 Sep 11 00:03:43.530700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-ffb043e7-b496-4ad9-ab4c-3c6b49c0a3c7 req-58c0f1f9-77af-421a-a540-dd63133919af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096435 Sep 11 00:03:43.532638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 184/379] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:03:43.891790 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:43.892652 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:43.917347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:43.917757 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:43.918199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:43.918922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:43.919374 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:43.920037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:44.013878 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:44.041654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:44.049129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:44.056238 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a4f646ee-4b35-40ce-9ba9-073d02a91952 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.585919 Sep 11 00:03:44.062030 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 196/380] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:43 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:44.208640 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:44.219715 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-32d2be46-8d38-4723-adf1-5774b3ee97c9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1708 microversion: 2.1 time: 0.333454 Sep 11 00:03:44.220638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 185/381] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:43 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1708 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:44.430072 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:44.431059 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:44.454635 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:44.456157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:44.456613 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:44.457393 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:44.457894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:44.458318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:44.487463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:44.488130 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:44.508464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:44.509124 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:44.509653 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:44.510792 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:44.511445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:44.512044 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:44.607354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=16 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:44.789057 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:44.798158 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ff6a4f14-2861-405f-a48e-0c7d759c2885 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.314459 Sep 11 00:03:44.803995 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 186/382] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:44 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:45.039928 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:45.050561 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7ddeb45d-8ea7-4bb9-9341-4d9c699bf678 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.630564 Sep 11 00:03:45.051604 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 197/383] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:44 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:45.086146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:45.086918 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:45.100500 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:45.105154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:45.105861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:45.106883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:45.112057 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:45.112576 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:45.244694 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:45.245495 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:45.252303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:45.253474 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:45.256468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:45.256468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:45.256468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:45.256468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:45.420027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:45.429564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3fdbdd84-8d87-4b19-afc5-30d5e5ca7a0e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1708 microversion: 2.1 time: 0.189173 Sep 11 00:03:45.436137 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 198/384] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:45 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1708 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:45.586606 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:45.595414 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:45.596836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:45.598219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-04a9c176-cdb1-40cb-bff0-602175e932d8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.517485 Sep 11 00:03:45.599768 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 187/385] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:45 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:45.825233 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:45.826801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:45.834961 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:45.835538 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:45.836037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:45.836942 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:45.837627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:45.838051 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:45.992601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:46.003744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a90c30de-408f-4392-b4bc-ca465b28f2d3 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.182740 Sep 11 00:03:46.005000 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 199/386] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:45 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:46.076962 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:46.077715 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:46.093475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:46.094347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:46.104977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:46.104977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:46.104977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:46.104977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:46.314627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:46.324435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-28247f6c-cf7d-4fcf-b662-37b88853484d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.251319 Sep 11 00:03:46.325292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 188/387] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:46 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:46.453593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:46.454195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:46.461244 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:46.461728 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:46.462158 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:46.462886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:46.463334 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:46.463842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:46.633913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:46.635503 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:46.643378 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:46.644904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:46.645771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:46.646298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:46.647606 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:46.648349 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:46.648813 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:46.664530 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-eba26965-da15-4cfe-9632-9c2f02b0c1d4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1708 microversion: 2.1 time: 0.214705 Sep 11 00:03:46.679598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 200/388] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:46 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1708 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:46.797531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:46.805982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:46.807496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:46.808745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-96d19db9-9192-4ed6-8d53-c64e230bb9db tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.184442 Sep 11 00:03:46.809410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 189/389] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:46 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:47.028533 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:47.029135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:47.035096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:47.035572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:47.036009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:47.036689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:47.037133 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:47.037551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:47.186689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:47.196506 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0798e60f-43e9-424f-8a4a-69fb864aee7e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.171818 Sep 11 00:03:47.197191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 201/390] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:47 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:47.350355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:47.351718 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:47.358485 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:47.359814 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:47.360497 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:47.361596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:47.362464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:47.363187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:47.523286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:47.531796 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bdbbb0a9-f0d3-4c8f-94d7-83067ee7d2bf tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.185859 Sep 11 00:03:47.532759 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 190/391] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:47 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:47.689381 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:47.690327 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:47.697679 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:47.698460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:47.698922 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:47.699618 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:47.700063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:47.700479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:47.835966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:47.836582 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:47.843205 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:47.843719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:47.844148 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:47.844847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:47.845301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:47.845716 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:47.856367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:47.864768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-419fdcdd-e48f-4946-9bff-66a18bdd6404 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1708 microversion: 2.1 time: 0.179194 Sep 11 00:03:47.872956 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 202/392] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:47 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1708 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:47.980392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:47.988554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:47.989993 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:47.992002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6e8fee03-3ed8-4e95-8938-fbdb170a5576 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.161028 Sep 11 00:03:47.992569 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 191/393] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:47 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:48.222964 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:48.223622 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:48.229581 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:48.230049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:48.230524 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:48.231331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:48.231776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:48.232221 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:48.379712 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:48.380571 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e92fb5b7-a180-450e-adc4-fa4c7f9b1226 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.161449 Sep 11 00:03:48.381147 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 203/394] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:48 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:48.556556 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:48.563304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:48.563655 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:48.564138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:48.564574 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:48.565264 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:48.565716 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:48.566144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:48.695882 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:48.703792 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4d59a0ff-7452-414d-baaf-611a6de3e96f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.151091 Sep 11 00:03:48.704362 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 192/395] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:48 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:48.891019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:48.891630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:48.898318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:48.898879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:48.899311 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:48.900003 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:48.900468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:48.900892 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:49.019786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:49.021173 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:49.030324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:49.031105 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:49.037023 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:49.037023 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:49.037023 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:49.037023 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:49.052627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:49.062069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a7dda904-29d8-40ae-991c-b1d1d5970d1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1708 microversion: 2.1 time: 0.174917 Sep 11 00:03:49.065932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 204/396] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:48 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1708 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:49.172971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:49.181835 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:49.183301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:49.184488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-924a50d1-0d75-4bf6-9ba7-6a872b6d44e5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1738 microversion: 2.20 time: 0.170965 Sep 11 00:03:49.185042 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 193/397] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:49 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:03:49.404790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:49.406171 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:49.412326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:49.413065 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:49.413569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:49.414266 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:49.415180 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:49.415478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:49.645685 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:49.653500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a3affc4a-20e6-47b1-9fb5-52d42400c4ee tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.253388 Sep 11 00:03:49.654064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 205/398] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:49 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:49.727722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:49.728361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:49.734515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:49.735028 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:49.735461 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:49.736154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:49.737225 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:49.737652 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:49.877194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-058f5699-71ca-47ec-b14d-f4efa7aabedb req-8a47ebf3-0458-4a68-ba5a-095bd65a0c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d5a6b91-ea62-4218-b010-549ce18c06fe", "name": "network-vif-plugged", "status": "completed", "tag": "d6355983-d4da-4770-b3cb-d3be0b42bd62"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:49.883106 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:49.893826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-058f5699-71ca-47ec-b14d-f4efa7aabedb req-8a47ebf3-0458-4a68-ba5a-095bd65a0c0c service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:49.894602 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-058f5699-71ca-47ec-b14d-f4efa7aabedb req-8a47ebf3-0458-4a68-ba5a-095bd65a0c0c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:49.895129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-058f5699-71ca-47ec-b14d-f4efa7aabedb req-8a47ebf3-0458-4a68-ba5a-095bd65a0c0c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:49.901046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:49.909013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-76a42f05-8aff-47c2-a21c-b43f0bc1d6f5 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.185507 Sep 11 00:03:49.909194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-058f5699-71ca-47ec-b14d-f4efa7aabedb req-8a47ebf3-0458-4a68-ba5a-095bd65a0c0c service nova] Creating event network-vif-plugged:d6355983-d4da-4770-b3cb-d3be0b42bd62 for instance 6d5a6b91-ea62-4218-b010-549ce18c06fe on hv-cinder-85200 Sep 11 00:03:49.909589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 194/399] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:49 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:49.918642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-058f5699-71ca-47ec-b14d-f4efa7aabedb req-8a47ebf3-0458-4a68-ba5a-095bd65a0c0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045128 Sep 11 00:03:49.919383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 206/400] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:03:50.088772 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:50.089516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:50.100600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:50.100600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:50.100600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:50.100600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:50.100920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:50.100920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:50.216618 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:50.217660 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:50.224827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:50.225756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:50.226443 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:50.227394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:50.228104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:50.228744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:50.286635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:50.296463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2e9adb3c-d6fd-41ce-a335-dbece16140e4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1712 microversion: 2.1 time: 0.211829 Sep 11 00:03:50.307426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 195/401] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:50 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1712 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:50.632825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:50.641813 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:50.643296 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:50.644775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9673367e-ee8b-4299-b08a-063072d5b51c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1720 microversion: 2.20 time: 0.437899 Sep 11 00:03:50.645693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 207/402] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:50 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1720 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:50.676432 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:50.677158 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:50.683564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:50.685863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:50.685863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:50.685863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:50.685863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:50.686488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:50.691743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:50.837110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:50.845359 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7c7389f9-59f5-48f2-b748-fab2aac6f89e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.172798 Sep 11 00:03:50.846179 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 196/403] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:50 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:50.935890 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:50.936505 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:50.942552 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:50.943612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:50.944392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:50.945565 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:50.946041 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:50.946457 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:51.114182 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:51.123070 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-38dd4e83-8b17-4efd-aa18-7ac7032b28f2 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.190861 Sep 11 00:03:51.123730 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 208/404] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:50 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:51.672307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:51.672992 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:51.679856 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:51.680587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:51.681378 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:51.682405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:51.683095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:51.683776 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:51.828085 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:51.838611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:51.848999 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:51.848999 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6320a71e-bc4d-423d-afb9-9642de1238ec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1720 microversion: 2.20 time: 0.175781 Sep 11 00:03:51.856181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 197/405] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:51 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:51.873119 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:51.873119 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:51.879274 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:51.879838 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:51.880339 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:51.881178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:51.881929 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:51.882427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:52.029180 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:52.037198 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-21ab4830-c078-4f18-89c2-abfe4f98b089 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.170833 Sep 11 00:03:52.037872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 209/406] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:51 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:52.146475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:52.147438 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:52.154291 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:52.154822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:52.155249 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:52.156144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:52.156723 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:52.157139 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:52.299593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:52.308077 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4f1ce695-e8b1-4c2b-9c08-8c45afae56f6 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.165340 Sep 11 00:03:52.310355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 198/407] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:52 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:52.873730 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:52.874383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:52.880466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:52.880945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:52.881442 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:52.882224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:52.882687 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:52.883108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:53.017617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:53.026116 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:53.027623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:53.028814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ed817fbc-5b74-4119-8166-d1cbd151944e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1720 microversion: 2.20 time: 0.159104 Sep 11 00:03:53.029455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 210/408] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:52 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:53.063598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:53.064241 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:53.072206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:53.072682 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:53.073116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:53.073797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:53.074231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:53.074645 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:53.203532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:53.212010 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1a16c64f-65b8-4bd8-863f-dd058bd9ab49 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.152475 Sep 11 00:03:53.212667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 199/409] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:53 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:53.337906 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:53.338568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:53.344472 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:53.344949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:53.345381 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:53.346066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:53.346516 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:53.346978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:53.479076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:53.486630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-530113a7-5e4a-4c73-a027-8296e0b4390c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1317 microversion: 2.1 time: 0.153159 Sep 11 00:03:53.487222 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 211/410] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:53 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:03:53.905052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-5305cb49-144e-4399-a9ed-44cf60ddc549 req-e57efd5d-3806-4097-9fa8-cd1e9fd560c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65cfc71-51a9-461d-a845-b46e71080e92", "name": "network-vif-plugged", "status": "completed", "tag": "d1ad97b5-d674-4dfa-b8e0-dd3bb492e819"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:53.915622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-5305cb49-144e-4399-a9ed-44cf60ddc549 req-e57efd5d-3806-4097-9fa8-cd1e9fd560c1 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:53.916035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-5305cb49-144e-4399-a9ed-44cf60ddc549 req-e57efd5d-3806-4097-9fa8-cd1e9fd560c1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:53.916465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-5305cb49-144e-4399-a9ed-44cf60ddc549 req-e57efd5d-3806-4097-9fa8-cd1e9fd560c1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:53.927254 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-5305cb49-144e-4399-a9ed-44cf60ddc549 req-e57efd5d-3806-4097-9fa8-cd1e9fd560c1 service nova] Creating event network-vif-plugged:d1ad97b5-d674-4dfa-b8e0-dd3bb492e819 for instance c65cfc71-51a9-461d-a845-b46e71080e92 on hv-cinder-85200 Sep 11 00:03:53.932846 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-5305cb49-144e-4399-a9ed-44cf60ddc549 req-e57efd5d-3806-4097-9fa8-cd1e9fd560c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Sep 11 00:03:53.933418 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 200/411] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:03:54.055276 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:54.055955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:54.061919 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:54.062404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:54.063223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:54.063923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:54.064535 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:54.064961 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:54.199310 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:54.207438 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:54.208906 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:54.210930 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fd3310cf-34b0-4213-8ec8-b30341cee64a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1720 microversion: 2.20 time: 0.159887 Sep 11 00:03:54.211487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 212/412] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:54 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:54.235340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:54.236380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:54.243215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:54.243926 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:54.244359 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:54.246829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:54.246829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:54.246829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:54.412382 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:54.423918 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d0103c76-dbc1-41b6-9eeb-eac4867b7d3d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.193190 Sep 11 00:03:54.424846 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 201/413] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:54 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:54.511445 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:54.512001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:54.517881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:54.518362 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:54.518825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:54.519515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:54.519962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:54.520374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:54.547118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:03:54.677100 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:54.686361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b1b4e356-a814-46a8-8e5a-3020b1de57cd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1506 microversion: 2.1 time: 0.178944 Sep 11 00:03:54.687236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 213/414] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:54 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:55.237461 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:55.238173 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:55.244812 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:55.245294 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:55.245731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:55.246426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:55.246902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:55.247325 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:55.427758 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:55.437212 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:55.438676 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:55.439823 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f111990a-0710-4ad6-9346-8f3d71cd2549 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1723 microversion: 2.20 time: 0.206287 Sep 11 00:03:55.440568 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 202/415] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:55 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:55.449859 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:55.451011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:55.461274 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:55.462343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:55.463014 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:55.463967 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:55.464504 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:55.465141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:55.470591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab1c9f18-512b-4487-a0fb-1026282e38fe"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:55.473420 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:55.479638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:55.480159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:55.482419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:55.482419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:55.482419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:55.482922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:55.637006 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:55.645549 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-207490d7-f4ff-468c-b411-e72d6f9386f1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.201786 Sep 11 00:03:55.646382 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 214/416] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:55 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:55.948420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-25c5e891-7b5e-4324-8300-59b7f444e23a req-c3fb5586-0623-4eab-b74b-987622f71606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b206b090-4c06-4bf1-a005-379f4056da27", "name": "network-vif-unplugged", "status": "completed", "tag": "13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:55.957891 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-25c5e891-7b5e-4324-8300-59b7f444e23a req-c3fb5586-0623-4eab-b74b-987622f71606 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:55.963697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-25c5e891-7b5e-4324-8300-59b7f444e23a req-c3fb5586-0623-4eab-b74b-987622f71606 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:55.963697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-25c5e891-7b5e-4324-8300-59b7f444e23a req-c3fb5586-0623-4eab-b74b-987622f71606 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:55.970279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.compute.server_external_events [req-25c5e891-7b5e-4324-8300-59b7f444e23a req-c3fb5586-0623-4eab-b74b-987622f71606 service nova] Unable to find a host for instance b206b090-4c06-4bf1-a005-379f4056da27. Dropping event network-vif-unplugged {{(pid=121067) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 11 00:03:55.971197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-25c5e891-7b5e-4324-8300-59b7f444e23a req-c3fb5586-0623-4eab-b74b-987622f71606 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027711 Sep 11 00:03:55.971771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 215/417] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 11 00:03:56.580513 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-33d38e9a-05d5-4b69-9ccf-b9efe4b9b02a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.115951 Sep 11 00:03:56.581133 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 203/418] 10.222.0.17 () {62 vars in 1364 bytes} [Sun Sep 11 00:03:55 2022] POST /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 188 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 00:03:56.670340 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:56.671742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:56.677790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:56.678501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:56.679166 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:56.680184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:56.680927 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:56.681551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:56.729451 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:56.730038 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:56.742449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:56.744001 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:56.748020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:56.748966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:56.749429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:56.749915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:56.799127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121068) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 00:03:56.860951 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:56.869808 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-05a612d1-7445-429f-b978-55402d4cbc9f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1370 microversion: 2.1 time: 0.203732 Sep 11 00:03:56.870534 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 216/419] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:56 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:57.191772 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-224a8b20-1892-449c-bac4-71eb2c250f76 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/action" status: 202 len: 0 microversion: 2.20 time: 0.466187 Sep 11 00:03:57.192634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 204/420] 10.222.0.17 () {62 vars in 1319 bytes} [Sun Sep 11 00:03:56 2022] POST /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:03:57.205629 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:57.206415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:57.214044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:57.214526 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:57.214999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:57.219424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:57.219424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:57.219424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:57.378874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:57.389454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:57.395590 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:57.399856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a496b783-55f6-4336-9b73-e5cc21bb2a21 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1749 microversion: 2.20 time: 0.200442 Sep 11 00:03:57.400681 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 217/421] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:57 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1749 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:57.896109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:57.899426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:57.908345 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:57.908862 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:57.909299 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:57.910105 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:57.910781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:57.911233 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:58.127064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:58.135751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ce604824-9346-4431-ba5d-3d9b47198057 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1563 microversion: 2.1 time: 0.244836 Sep 11 00:03:58.136231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 205/422] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:03:57 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:03:58.161162 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:58.161712 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:58.173415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:58.173904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:58.174329 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:58.177720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:58.177720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:58.177720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:58.263677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c36e0a60-5de3-4e23-91c6-f00cfcd50e10 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108170 Sep 11 00:03:58.264510 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 218/423] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Sep 11 00:03:58 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:03:58.432471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:58.433387 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:58.442969 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:58.446005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:58.446799 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:58.448628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:58.449290 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:58.450330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:58.633843 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:58.643138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:58.644539 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:58.645682 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c2945cb3-99a0-464d-bac2-5a30d1850a90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1749 microversion: 2.20 time: 0.222956 Sep 11 00:03:58.646611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 206/424] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:58 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1749 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:03:59.652241 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-40189221-293a-40ba-b5a4-249a720c26e2 req-da360ab9-869c-4be8-9487-40cb6e399ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65cfc71-51a9-461d-a845-b46e71080e92", "tag": "d1ad97b5-d674-4dfa-b8e0-dd3bb492e819"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:03:59.661741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-40189221-293a-40ba-b5a4-249a720c26e2 req-da360ab9-869c-4be8-9487-40cb6e399ec8 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:59.662988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-40189221-293a-40ba-b5a4-249a720c26e2 req-da360ab9-869c-4be8-9487-40cb6e399ec8 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:59.663244 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-40189221-293a-40ba-b5a4-249a720c26e2 req-da360ab9-869c-4be8-9487-40cb6e399ec8 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:59.671628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:03:59.678392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:03:59.678566 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-40189221-293a-40ba-b5a4-249a720c26e2 req-da360ab9-869c-4be8-9487-40cb6e399ec8 service nova] Creating event network-changed:d1ad97b5-d674-4dfa-b8e0-dd3bb492e819 for instance c65cfc71-51a9-461d-a845-b46e71080e92 on hv-cinder-85200 Sep 11 00:03:59.678955 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:59.679652 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:59.680300 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:59.680600 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-40189221-293a-40ba-b5a4-249a720c26e2 req-da360ab9-869c-4be8-9487-40cb6e399ec8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Sep 11 00:03:59.680994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:03:59.681383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 219/425] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:03:59.681504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:03:59.681838 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:03:59.844398 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:59.862175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:59.872160 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:03:59.874053 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-671b85e4-9970-49cf-bf5f-584248d2c588 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1751 microversion: 2.20 time: 0.205735 Sep 11 00:03:59.877043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 207/426] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:03:59 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1751 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:04:00.902178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:00.902926 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:00.909361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:00.909860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:00.910294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:00.911026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:00.911481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:00.911905 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:01.071826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:01.081144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:01.083035 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:01.084213 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-53480f18-8ae9-42f2-aaf8-17c58bac54c0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1751 microversion: 2.20 time: 0.186607 Sep 11 00:04:01.084748 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 220/427] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:00 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:02.113546 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:02.114208 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:02.123235 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:02.130532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:02.130532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:02.130532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:02.130532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:02.130913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:02.284380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:02.294348 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:02.296194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:02.297399 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c09d81fd-05c5-49ea-8519-67c3797718e9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.188017 Sep 11 00:04:02.297926 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 208/428] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:02 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:04:03.323991 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:03.324599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:03.330993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:03.331479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:03.331913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:03.332603 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:03.333232 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:03.333675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:03.475575 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:03.485224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:03.486721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:03.487945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-df639906-93db-4043-9fa6-7a8805135fdb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.168166 Sep 11 00:04:03.488455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 221/429] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:03 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:04:04.515252 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:04.516203 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:04.518850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:04:04.524043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:04.524721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:04.525218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:04.526007 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:04.526518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:04.527031 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:04.674431 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:04.678446 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:04:04.685961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:04.687720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:04.689852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-da49a204-f8a2-4c60-b0af-a44d9817acd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.178177 Sep 11 00:04:04.689852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 209/430] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:04 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:04:05.716371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:05.717180 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:05.723555 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:05.724621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:05.725285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:05.726922 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:05.727688 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:05.728290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:05.897138 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:05.907255 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:05.908859 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:05.910203 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4b3aa10c-df87-4f72-bb9e-27db41fcfd47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.197938 Sep 11 00:04:05.910938 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 222/431] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:05 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:06.939397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:06.939397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:06.948725 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:06.949430 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:06.950152 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:06.951334 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:06.951978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:06.952489 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:07.091188 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:07.100406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:07.103026 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:07.104235 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9ebbd41a-af8e-4c48-82b8-80c2547d3107 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.171285 Sep 11 00:04:07.104789 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 210/432] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:06 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:08.131670 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:08.132311 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:08.139478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:08.140174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:08.140686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:08.141459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:08.141904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:08.142426 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:08.298791 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:08.310399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:08.312834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:08.314019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-19d34660-6554-48d8-99af-4b6e5c18ee8e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.186437 Sep 11 00:04:08.314573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 223/433] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:08 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:09.341886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:09.342620 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:09.348873 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:09.349350 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:09.349784 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:09.350468 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:09.350943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:09.351364 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:09.502334 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:09.512691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:09.514031 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:09.515231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-25530bb7-a290-418f-b4d5-268d95ead46b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.178737 Sep 11 00:04:09.515788 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 211/434] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:09 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:10.543691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:10.545044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:10.551863 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:10.552453 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:10.552889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:10.553784 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:10.554240 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:10.554655 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:10.706292 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:10.716383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:10.717864 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:10.719085 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e46e50d4-ef25-4d23-afa0-57ec0716fb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.181509 Sep 11 00:04:10.719644 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 224/435] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:10 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:11.747730 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:11.748976 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:11.769947 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:11.770437 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:11.770896 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:11.771600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:11.772051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:11.772474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:11.948974 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:11.962004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:11.964144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:11.965375 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e3f270be-f91a-4953-b8cd-7523c0dfa369 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.224028 Sep 11 00:04:11.966146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 212/436] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:11 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:12.991716 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:12.992338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:12.998346 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:12.998872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:12.999311 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:13.000006 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:13.000457 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:13.000879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:13.140461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:13.150984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:13.152702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:13.153986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c9936132-78f6-47e0-851f-0d6d9361da47 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.166431 Sep 11 00:04:13.154539 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 225/437] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:12 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:14.181343 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:14.182201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:14.188946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:14.189433 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:14.189952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:14.190767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:14.191215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:14.196911 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:14.335828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:14.344805 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:14.346240 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:14.347425 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0b196af6-b325-460b-a5a5-e17666fc3aef tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.170054 Sep 11 00:04:14.347970 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 213/438] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:14 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:15.377130 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:15.377730 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:15.383939 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:15.385254 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:15.386081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:15.387523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:15.388790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:15.389635 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:15.523437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:15.532178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:15.533759 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:15.535238 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-09ba1cf8-10e4-44dc-a3ef-e04c249795fe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.162096 Sep 11 00:04:15.538810 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 226/439] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:15 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:16.561558 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:16.562530 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:16.569154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:16.573627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:16.573627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:16.573627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:16.573627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:16.574006 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:16.708229 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:16.717438 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:16.718961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:16.720117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-639dfb09-8149-4277-94d0-69217d102b86 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.162580 Sep 11 00:04:16.720673 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 214/440] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:16 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:16.917587 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "315da87d-c287-4689-8050-38e4722f3a4f", "device": "/dev/sdb"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:04:16.920598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:16.926895 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:16.927386 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:16.927909 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:16.928525 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:16.928972 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:16.929394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:17.746012 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:17.746653 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:17.753392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:17.753906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:17.754471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:17.755285 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:17.755738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:17.756195 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:17.785596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7e026f0c-7a6b-4628-bda6-7d368117e950 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "POST /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872941 Sep 11 00:04:17.786289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 227/441] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:04:16 2022] POST /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:04:17.900691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:17.909854 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:17.912822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:17.914059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b94e5eeb-ee56-4493-afdc-36d90e573370 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.172114 Sep 11 00:04:17.914594 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 215/442] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:17 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:04:18.941190 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:18.952894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:18.952894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:18.952894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:18.952894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:18.954141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:18.954141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:18.954141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:19.088668 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:19.097549 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:19.099163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:19.100303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f5aef6be-90ea-483a-b0d1-f76023bf8c2d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.164068 Sep 11 00:04:19.100850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 228/443] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:18 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:20.126644 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:20.127230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:20.133583 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:20.134036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:20.134505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:20.135216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:20.135661 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:20.136080 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:20.272800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:20.281181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:20.282591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:20.283773 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-af4ed8e1-549b-4d1e-b4cd-cf6d0c1acba0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.161165 Sep 11 00:04:20.284332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 216/444] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:20 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:21.309886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:21.309886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:21.312278 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=46 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:04:21.317237 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:21.317777 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:21.318256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:21.319210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:21.319679 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:21.320096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:21.450173 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:21.464084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:21.465519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:21.466703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4d8bc61b-44d8-4a08-b453-93c68030f1ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.161307 Sep 11 00:04:21.467257 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 229/445] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:21 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:22.491880 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:22.492491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:22.499038 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:22.499505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:22.499929 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:22.500599 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:22.501037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:22.501447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:22.645975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:22.654711 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:22.656195 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:22.657367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-da57e07e-cf3c-439f-a118-ba883afc24ad tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.169374 Sep 11 00:04:22.657920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 217/446] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:22 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:04:23.683650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:23.684259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:23.690701 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:23.691186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:23.691619 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:23.692297 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:23.692745 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:23.693164 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:23.708477 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:04:23.832785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:23.843189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:23.844870 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:23.846316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3ce07293-9fc9-4ab4-8f82-7e1faf58791d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.167239 Sep 11 00:04:23.847472 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 230/447] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:23 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:24.873950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:24.874486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:24.880951 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:24.881440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:24.881875 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:24.882557 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:24.883036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:24.883460 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:25.018883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:25.028121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:25.029543 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:25.030698 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-683c319a-d660-468c-a173-174c3e146b74 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.160725 Sep 11 00:04:25.031245 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 218/448] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:24 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:25.998571 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-dfb69db5-2d5a-46cd-90de-9c4e090fa410 req-4f62cba8-7912-4047-9e4d-375e3130b89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b206b090-4c06-4bf1-a005-379f4056da27", "name": "network-vif-plugged", "status": "completed", "tag": "13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:04:26.008999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-dfb69db5-2d5a-46cd-90de-9c4e090fa410 req-4f62cba8-7912-4047-9e4d-375e3130b89d service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:26.009466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-dfb69db5-2d5a-46cd-90de-9c4e090fa410 req-4f62cba8-7912-4047-9e4d-375e3130b89d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:26.010102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-dfb69db5-2d5a-46cd-90de-9c4e090fa410 req-4f62cba8-7912-4047-9e4d-375e3130b89d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:26.023129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-dfb69db5-2d5a-46cd-90de-9c4e090fa410 req-4f62cba8-7912-4047-9e4d-375e3130b89d service nova] Creating event network-vif-plugged:13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1 for instance b206b090-4c06-4bf1-a005-379f4056da27 on hv-cinder-85200 Sep 11 00:04:26.028124 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-dfb69db5-2d5a-46cd-90de-9c4e090fa410 req-4f62cba8-7912-4047-9e4d-375e3130b89d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034317 Sep 11 00:04:26.031989 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 231/449] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:04:26.054994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:26.065271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:26.065271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:26.065271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:26.065271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:26.065644 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:26.065644 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:26.065644 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:26.204266 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:26.213534 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:26.215206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:26.216442 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4ba100c7-e39d-4151-8ffe-cd4ab66f8bd9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.165395 Sep 11 00:04:26.217030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 219/450] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:26 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:27.245439 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:27.246124 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:27.253263 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:27.253744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:27.254170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:27.254887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:27.255331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:27.255745 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:27.387857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:27.396411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:27.397843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:27.399015 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5f310e6c-02ed-4d26-900a-96487195664d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.158542 Sep 11 00:04:27.399571 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 232/451] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:27 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:28.425263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:28.425864 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:28.432683 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:28.433164 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:28.433597 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:28.434311 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:28.434791 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:28.435215 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:28.576791 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:28.587134 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:28.589694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:28.591232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b966fbb6-2929-4810-9a97-185de9d5cf63 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.169835 Sep 11 00:04:28.592097 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 220/452] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:28 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:29.617804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:29.620291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:29.626999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:29.627476 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:29.627907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:29.628617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:29.629064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:29.629608 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:29.759519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:29.768321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:29.769773 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:29.770938 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6308e4e8-046b-4722-a7b2-5298681705f2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.157893 Sep 11 00:04:29.771484 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 233/453] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:29 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:30.798066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:30.798596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:30.804969 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:30.805439 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:30.805864 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:30.806545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:30.807008 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:30.807431 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:30.939008 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:30.948410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:30.949848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:30.951139 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f88f1973-506c-46d0-a2a0-fd390b235158 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.157014 Sep 11 00:04:30.951693 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 221/454] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:30 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:04:31.979649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:31.980360 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:31.986631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:31.987138 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:31.987568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:31.991271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:31.991271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:31.991271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:32.120550 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:32.129120 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:32.130544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:32.131737 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e8ed8670-5f97-49da-adcf-547c17e021a1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.156154 Sep 11 00:04:32.132284 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 234/455] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:31 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:33.157437 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:33.157951 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:33.164613 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:33.165087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:33.165514 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:33.167054 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:33.167596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:33.168014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:33.294638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:33.303761 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:33.305182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:33.306327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-651d51f6-dc7d-432c-abba-8a407d3fc1b7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.152837 Sep 11 00:04:33.307479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 222/456] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:33 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:34.332152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:34.332795 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:34.340143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:34.340611 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:34.341037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:34.341710 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:34.342154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:34.342567 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:34.475514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:34.484147 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:34.485576 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:34.486759 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a18f7145-34b5-4794-ab27-29bb71ba1e80 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.158479 Sep 11 00:04:34.487314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 235/457] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:34 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:35.512884 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:35.513486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:35.516214 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=28 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:04:35.521080 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:35.521568 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:35.522005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:35.522730 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:35.523186 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:35.528844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:35.655441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:35.664072 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:35.665579 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:35.666801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-577877b6-fd3d-42b5-b088-ceb323473d9c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1807 microversion: 2.20 time: 0.158390 Sep 11 00:04:35.667557 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 223/458] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:35 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:36.692704 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:36.693312 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:36.700057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:36.700540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:36.701008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:36.701698 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:36.702145 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:36.702567 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:36.836246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:36.846305 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:36.847810 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:36.848902 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bf834e0f-972f-4904-8b6c-d3559f064269 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1794 microversion: 2.20 time: 0.160105 Sep 11 00:04:36.849458 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 236/459] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:04:36 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:04:44.682509 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:44.683170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:44.689377 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:44.689853 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:44.690284 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:44.690998 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:44.691447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:44.691869 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:44.694311 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=86 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:04:44.818748 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lazy-loading 'services' on Instance uuid 6d5a6b91-ea62-4218-b010-549ce18c06fe {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:04:45.073184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-83c3ac4f-191b-4ad5-873e-8d65a0ce7606 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe/os-volume_attachments/315da87d-c287-4689-8050-38e4722f3a4f" status: 202 len: 0 microversion: 2.1 time: 0.395169 Sep 11 00:04:45.073792 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 224/460] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:04:44 2022] DELETE /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe/os-volume_attachments/315da87d-c287-4689-8050-38e4722f3a4f => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:04:47.258181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:47.258716 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:47.261063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=15 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:04:47.261856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=35 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:04:47.266350 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:47.271412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:47.271412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:47.271412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:47.271412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:47.271759 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:47.297732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:04:47.578489 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5232cf68-3007-49ea-be71-06bce389944b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 204 len: 0 microversion: 2.1 time: 0.323972 Sep 11 00:04:47.579123 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 237/461] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:04:47 2022] DELETE /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:04:47.588451 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:47.589250 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:47.596030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:47.596518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:47.596956 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:47.597642 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:47.598097 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:47.598560 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:47.730191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:47.737793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bd89f61c-7d57-4b48-bd59-adbfb8120d62 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1512 microversion: 2.1 time: 0.154168 Sep 11 00:04:47.738347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 225/462] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:04:47 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:04:48.761447 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:48.762137 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:48.768746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:48.769219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:48.769646 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:48.770316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:48.770780 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:48.771194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:48.899055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:48.907178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0d4bda28-ee27-439f-a61f-fe303cdb6773 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1512 microversion: 2.1 time: 0.150517 Sep 11 00:04:48.907734 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 238/463] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:04:48 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:04:49.930709 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:49.931338 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:49.938167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:49.938637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:49.939088 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:49.939785 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:49.940230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:49.940643 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:50.074071 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:50.081858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-264fb4d2-a938-4940-b2d2-493aad8fc15c tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1512 microversion: 2.1 time: 0.155069 Sep 11 00:04:50.082423 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 226/464] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:04:49 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:04:50.400827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-cd6a15d1-7f40-47ba-b9dd-6b106bde6cfc req-ef32e92b-b489-480d-abc2-99b2009e55cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d5a6b91-ea62-4218-b010-549ce18c06fe", "name": "network-vif-deleted", "tag": "d6355983-d4da-4770-b3cb-d3be0b42bd62"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:04:50.410983 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-cd6a15d1-7f40-47ba-b9dd-6b106bde6cfc req-ef32e92b-b489-480d-abc2-99b2009e55cd service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:50.414189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-cd6a15d1-7f40-47ba-b9dd-6b106bde6cfc req-ef32e92b-b489-480d-abc2-99b2009e55cd service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:50.414189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-cd6a15d1-7f40-47ba-b9dd-6b106bde6cfc req-ef32e92b-b489-480d-abc2-99b2009e55cd service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:50.423956 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-cd6a15d1-7f40-47ba-b9dd-6b106bde6cfc req-ef32e92b-b489-480d-abc2-99b2009e55cd service nova] Creating event network-vif-deleted:d6355983-d4da-4770-b3cb-d3be0b42bd62 for instance 6d5a6b91-ea62-4218-b010-549ce18c06fe on hv-cinder-85200 Sep 11 00:04:50.428763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-cd6a15d1-7f40-47ba-b9dd-6b106bde6cfc req-ef32e92b-b489-480d-abc2-99b2009e55cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Sep 11 00:04:50.429342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 239/465] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:04:51.106224 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:51.106915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:51.113442 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:51.113922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:51.114353 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:51.115061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:51.115509 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:51.115931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:51.147924 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:51.148393 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:51.148833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:51.149271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lazy-loading 'fault' on Instance uuid 6d5a6b91-ea62-4218-b010-549ce18c06fe {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:04:51.193136 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:04:51.201995 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-44c62592-9d98-49d7-b3e5-671b2c1e1dfd tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 200 len: 1307 microversion: 2.1 time: 0.100398 Sep 11 00:04:51.202553 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 227/466] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:04:51 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:04:52.226678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:52.227390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: 6d5a6b91-ea62-4218-b010-549ce18c06fe] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:52.233673 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:52.234275 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:52.234798 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:52.235488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:52.235964 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:52.236381 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:52.249730 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] HTTP exception thrown: Instance 6d5a6b91-ea62-4218-b010-549ce18c06fe could not be found. Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Request method failure captured: Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe HTTP/1.1 Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSXNVxLlRui4krsAlalKZ35Wsx34JcRdococ3S-v9c9yqWr_rUkALejK5s4mESSxi2PIvKmBKn-wjMiUA_ivGndVvW7y6EjuoBIGhYJ3SkO4aqvtAL2AkzSNSoNs28q7w9MVHJZhUoe_8RxMqDLn_EbwtwCNSVKSGU_4Ui4Z7nEC_08 Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: fa03f6136eb640ad803659779ce1b085 Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-VolumesSnapshotTestJSON-469934344 Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:04:52.251348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa03f6136eb640ad803659779ce1b085", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa03f6136eb640ad803659779ce1b085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa03f6136eb640ad803659779ce1b085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa03f6136eb640ad803659779ce1b085"}]}] Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-VolumesSnapshotTestJSON-469934344 Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: fa03f6136eb640ad803659779ce1b085 Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-469934344 Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-VolumesSnapshotTestJSON-469934344-project Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 017684196c8e49e0894d38daf83bfaeb Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-VolumesSnapshotTestJSON-469934344-project Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 6d5a6b91-ea62-4218-b010-549ce18c06fe could not be found. Sep 11 00:04:52.252873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '6d5a6b91-ea62-4218-b010-549ce18c06fe'} Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d5a6b91-ea62-4218-b010-549ce18c06fe could not be found. Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:04:52.253757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d5a6b91-ea62-4218-b010-549ce18c06fe could not be found. Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d5a6b91-ea62-4218-b010-549ce18c06fe could not be found. Sep 11 00:04:52.255316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:04:52.256943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Returning 404 to user: Instance 6d5a6b91-ea62-4218-b010-549ce18c06fe could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:04:52.256943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4724b044-65d9-4d17-b21a-59778f0c7e47 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe" status: 404 len: 111 microversion: 2.1 time: 0.030776 Sep 11 00:04:52.256943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 240/467] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:04:52 2022] GET /compute/v2.1/servers/6d5a6b91-ea62-4218-b010-549ce18c06fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:04:57.565341 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:04:57.565930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:57.572557 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:57.573025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:57.574066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:57.574198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:57.574538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:57.574981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:57.654805 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lazy-loading 'services' on Instance uuid 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:04:57.852103 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-10c143e3-8122-4c87-987b-b825b0d5a41a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/os-volume_attachments/b5e461d8-ee33-4d4e-a41e-9eb769bebf37" status: 202 len: 0 microversion: 2.1 time: 0.290399 Sep 11 00:04:57.852610 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 228/468] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:04:57 2022] DELETE /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/os-volume_attachments/b5e461d8-ee33-4d4e-a41e-9eb769bebf37 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:04:58.037641 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f4834f8-6bb2-4505-824f-c80d25249b7b"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:04:58.040192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:04:58.047379 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:58.047926 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:58.048284 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:58.048983 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:04:58.049523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:04:58.049958 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:04:59.153532 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fab06ecc-7629-492a-8a1c-f525e5245f6d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.119595 Sep 11 00:04:59.154263 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 241/469] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:04:58 2022] POST /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments => generated 194 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:05:02.193167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-18abf0d2-7fb8-4bc5-a287-b4530d86a40c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:02.200344 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18abf0d2-7fb8-4bc5-a287-b4530d86a40c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:02.200825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18abf0d2-7fb8-4bc5-a287-b4530d86a40c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:02.201283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-18abf0d2-7fb8-4bc5-a287-b4530d86a40c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:02.267424 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-18abf0d2-7fb8-4bc5-a287-b4530d86a40c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Going to try to stop instance {{(pid=121068) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 00:05:02.436302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-18abf0d2-7fb8-4bc5-a287-b4530d86a40c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/action" status: 202 len: 0 microversion: 2.1 time: 0.247578 Sep 11 00:05:02.436901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 229/470] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:05:02 2022] POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:05:02.446297 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:02.447139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:02.453949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:02.454463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:02.455009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:02.455701 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:02.456169 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:02.456695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:02.590052 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:02.597749 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6ad6e450-13b2-48c1-b736-a3262be01e6b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.156335 Sep 11 00:05:02.598314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 242/471] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:02 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:02.820584 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-773768657", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "networks": [{"uuid": "5e125d53-b157-4cfc-b72d-e9f0403df098"}]}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:02.877392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] validate_networks() for [('5e125d53-b157-4cfc-b72d-e9f0403df098', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:05:03.223104 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:05:03.223682 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:05:03.223964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:05:03.224360 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:05:03.224796 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:05:03.233838 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:03.234305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:03.234771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:03.235482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:03.235921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:03.236333 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:03.253022 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Getting quotas for project fa03f6136eb640ad803659779ce1b085. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:05:03.256972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Getting quotas for user 017684196c8e49e0894d38daf83bfaeb and project fa03f6136eb640ad803659779ce1b085. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:05:03.268505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:05:03.270860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:05:03.389604 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b47fd9f9-1e55-40c4-a0bf-e19468c45ede tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573340 Sep 11 00:05:03.390201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 230/472] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:05:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:05:03.401975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6f39dfd9-fd95-418c-a036-9f6bfc262511 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:03.402677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6f39dfd9-fd95-418c-a036-9f6bfc262511 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:03.468919 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6f39dfd9-fd95-418c-a036-9f6bfc262511 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:03.476694 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6f39dfd9-fd95-418c-a036-9f6bfc262511 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1218 microversion: 2.1 time: 0.079312 Sep 11 00:05:03.477255 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 243/473] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:03 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:03.621743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:03.622378 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:03.628650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:03.629166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:03.631373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:03.631373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:03.631373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:03.631373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:03.764791 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:03.773354 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-53d13749-be43-4120-bb20-204a275c32a0 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.155791 Sep 11 00:05:03.773930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 231/474] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:03 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:04.500344 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:04.501072 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:04.508039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:04.508517 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:04.508947 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:04.509700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:04.510111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:04.510548 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:04.580580 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:04.585088 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d02fc6a0-02b9-4902-a406-5daadf77bb7a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1222 microversion: 2.1 time: 0.088639 Sep 11 00:05:04.585651 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 244/475] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:04 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:04.796972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:04.797575 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:04.805523 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:04.806002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:04.806435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:04.807151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:04.807638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:04.808059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:04.936313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:04.943913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4c22493a-6ce5-4fef-bedf-f0856e77a33f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.150770 Sep 11 00:05:04.944505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 232/476] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:04 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:05.607275 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:05.607920 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:05.614991 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:05.615551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:05.615996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:05.616692 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:05.617141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:05.617564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:05.692497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:05.700764 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9843d6d8-19d3-450d-99d7-ff99ec200eb0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1270 microversion: 2.1 time: 0.097888 Sep 11 00:05:05.701329 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 245/477] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:05 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:05.967977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:05.968866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:05.971595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:05.976560 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:05.977151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:05.977665 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:05.978491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:05.979081 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:05.979721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:06.113818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:06.124558 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bc010b32-3795-4b3d-9e49-975cc839f9e5 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.160442 Sep 11 00:05:06.125232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 233/478] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:05 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:06.723222 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:06.723864 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:06.731219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:06.731703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:06.732140 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:06.732841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:06.733290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:06.733713 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:06.820253 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:06.828449 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f18acd53-dbf9-4bac-b5b5-29263b8bb051 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1276 microversion: 2.1 time: 0.109174 Sep 11 00:05:06.829020 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 246/479] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:06 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:07.149331 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:07.149984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:07.157593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:07.165025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:07.165025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:07.165025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:07.165025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:07.165386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:07.307229 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:07.316327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ebcc3482-504b-4584-9e74-2110f7736292 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.171859 Sep 11 00:05:07.317025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 234/480] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:07 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:07.852694 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:07.853378 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:07.859979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:07.860459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:07.860892 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:07.861584 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:07.862033 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:07.862454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:07.947132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-9996dea5-9d29-4af1-a9ee-936c2675f679 req-5e89f8e6-5e43-43fe-900b-20c9d6a22799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec7237ee-323d-4b9b-81d0-a14abcd0dca9", "tag": "6b7bd61b-3ef7-4cb7-aee5-38920b000863"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:07.957088 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-9996dea5-9d29-4af1-a9ee-936c2675f679 req-5e89f8e6-5e43-43fe-900b-20c9d6a22799 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:07.957548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-9996dea5-9d29-4af1-a9ee-936c2675f679 req-5e89f8e6-5e43-43fe-900b-20c9d6a22799 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:07.957963 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-9996dea5-9d29-4af1-a9ee-936c2675f679 req-5e89f8e6-5e43-43fe-900b-20c9d6a22799 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:07.969073 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-9996dea5-9d29-4af1-a9ee-936c2675f679 req-5e89f8e6-5e43-43fe-900b-20c9d6a22799 service nova] Creating event network-changed:6b7bd61b-3ef7-4cb7-aee5-38920b000863 for instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 on hv-cinder-85200 Sep 11 00:05:07.973887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-9996dea5-9d29-4af1-a9ee-936c2675f679 req-5e89f8e6-5e43-43fe-900b-20c9d6a22799 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030785 Sep 11 00:05:07.974652 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 235/481] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:05:08.047742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:08.055348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d9a4f932-b5e5-4d4b-8b7f-bcaefe35b19a tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1318 microversion: 2.1 time: 0.206914 Sep 11 00:05:08.057957 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 247/482] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:07 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:08.341506 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:08.342197 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:08.348263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:08.348737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:08.349169 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:08.349843 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:08.350287 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:08.350721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:08.479043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:08.488165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-76c75bb9-d1b5-4c67-98d5-7afd8538dc2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.151554 Sep 11 00:05:08.488738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 236/483] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:08 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:09.080134 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:09.081501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:09.088404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:09.088882 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:09.089313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:09.090008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:09.091543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:09.092397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:09.297023 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:09.305843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4b795409-371f-4088-8d90-959a7550fff0 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1318 microversion: 2.1 time: 0.229419 Sep 11 00:05:09.306761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 248/484] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:09 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:09.511451 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:09.512313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:09.518599 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:09.519096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:09.519526 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:09.520195 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:09.520635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:09.521043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:09.654384 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:09.662034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-255384f9-8ed7-4b6e-ae84-5ecd2b82ce9b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.154509 Sep 11 00:05:09.662587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 237/485] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:09 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:09.897063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:09.899389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:09.905913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:09.906388 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:09.906856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:09.907539 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:09.907987 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:09.908409 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:09.930944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lazy-loading 'flavor' on Instance uuid c65cfc71-51a9-461d-a845-b46e71080e92 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:05:10.185686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2b324d68-5f81-4307-9090-82f6c847154d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/action" status: 200 len: 32 microversion: 2.1 time: 0.292504 Sep 11 00:05:10.186345 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 249/486] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:05:09 2022] POST /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:05:10.195919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:10.196560 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:10.203390 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:10.203862 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:10.206967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:10.206967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:10.206967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:10.206967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:10.332460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:10.333289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:10.334647 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:10.339878 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:10.340393 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:10.340914 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:10.341804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:10.342247 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:10.342691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:10.343207 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e446a8f7-f8a2-45da-a717-8cb97aef7b0c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.151287 Sep 11 00:05:10.343774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 238/487] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:10 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:10.478780 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:10.482313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:10.486706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a11fa021-2d2e-4718-bb20-03009d43eff4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1318 microversion: 2.1 time: 0.158672 Sep 11 00:05:10.487270 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 250/488] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:10 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:10.686054 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:10.686706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:10.693441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:10.693918 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:10.694348 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:10.695127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:10.695839 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:10.696259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:10.711284 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:10.832013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:10.839887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-70e0fb76-5069-4874-87e1-0d2c54106e6a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.158440 Sep 11 00:05:10.840538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 239/489] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:10 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:11.365728 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:11.366330 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:11.373425 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:11.373927 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:11.374354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:11.375154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:11.375597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:11.381865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:11.509298 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:11.509611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:11.510221 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:11.517288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:11.517764 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:11.518216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:11.518330 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b6d30230-8817-4892-bccc-d5d2df7d571f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.156406 Sep 11 00:05:11.519137 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:11.519252 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 251/490] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:11 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:11.519434 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:11.519979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:11.649243 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:11.657606 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7846c9d6-d30b-4534-a7a1-cc3cdb4ad194 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1318 microversion: 2.1 time: 0.152118 Sep 11 00:05:11.658180 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 240/491] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:11 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:11.863256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:11.863780 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:11.869704 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:11.870182 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:11.870615 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:11.871845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:11.872536 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:11.873105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:12.010645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:12.019096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0b1eebe6-380d-4c70-b8dc-8d8469f975f1 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.159503 Sep 11 00:05:12.019659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 252/492] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:11 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:12.542182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:12.542794 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:12.549905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:12.550378 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:12.550848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:12.551527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:12.551967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:12.552383 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:12.680234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:12.680852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:12.685087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:12.687349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:12.687836 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:12.688268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:12.688956 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:12.689402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:12.689820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:12.693549 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a11fc5c2-2663-4f14-a8e6-0f299fe312cf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.155240 Sep 11 00:05:12.694194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 241/493] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:12 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:12.822033 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:12.829819 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4441c48a-30df-4813-9d65-556081c6886d tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1318 microversion: 2.1 time: 0.153474 Sep 11 00:05:12.832046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 253/494] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:12 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:13.041816 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:13.042426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:13.048402 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:13.050405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:13.050405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:13.050405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:13.050706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:13.050949 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:13.195733 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:13.204724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c49e657f-5a78-4829-a520-2aa390d18e6e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1676 microversion: 2.1 time: 0.167007 Sep 11 00:05:13.205289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 242/495] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:13 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:13.717126 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:13.717741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:13.719589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:13.724834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:13.729503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:13.729503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:13.729503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:13.729503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:13.729901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:13.854237 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:13.854870 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:13.856631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:13.857317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:13.857994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=6 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:13.863322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:13.865219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:13.865219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:13.865219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:13.865476 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f167d2cb-baec-438c-86f2-d6f04de25525 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.151888 Sep 11 00:05:13.865563 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:13.865695 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:13.866080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 254/496] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:13 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:13.994784 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:14.003330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c6430a9f-94c1-4923-8f93-6df75926de77 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1318 microversion: 2.1 time: 0.153176 Sep 11 00:05:14.003886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 243/497] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:13 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:14.234253 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:14.235241 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:14.241374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:14.241895 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:14.250717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:14.250717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:14.250717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:14.250717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:14.313901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-1b0af731-d807-4cd5-9dab-1d4877ee96d3 req-124d915a-ae45-4f9f-8cb9-4a1c9c86557b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec7237ee-323d-4b9b-81d0-a14abcd0dca9", "name": "network-vif-plugged", "status": "completed", "tag": "6b7bd61b-3ef7-4cb7-aee5-38920b000863"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:14.330543 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-1b0af731-d807-4cd5-9dab-1d4877ee96d3 req-124d915a-ae45-4f9f-8cb9-4a1c9c86557b service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:14.331081 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-1b0af731-d807-4cd5-9dab-1d4877ee96d3 req-124d915a-ae45-4f9f-8cb9-4a1c9c86557b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:14.331513 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-1b0af731-d807-4cd5-9dab-1d4877ee96d3 req-124d915a-ae45-4f9f-8cb9-4a1c9c86557b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:14.342424 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-1b0af731-d807-4cd5-9dab-1d4877ee96d3 req-124d915a-ae45-4f9f-8cb9-4a1c9c86557b service nova] Creating event network-vif-plugged:6b7bd61b-3ef7-4cb7-aee5-38920b000863 for instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 on hv-cinder-85200 Sep 11 00:05:14.347721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-1b0af731-d807-4cd5-9dab-1d4877ee96d3 req-124d915a-ae45-4f9f-8cb9-4a1c9c86557b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039254 Sep 11 00:05:14.348695 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 244/498] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:05:14.407044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:14.414804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9c4b9412-6471-4517-a949-b6c14c077a3f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1653 microversion: 2.1 time: 0.185121 Sep 11 00:05:14.415372 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 255/499] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:14 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1653 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:14.443692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-403db03b-5e55-45b5-a2c5-dca97e901feb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:14.451264 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-403db03b-5e55-45b5-a2c5-dca97e901feb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:14.451751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-403db03b-5e55-45b5-a2c5-dca97e901feb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:14.452191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-403db03b-5e55-45b5-a2c5-dca97e901feb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:14.477293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-403db03b-5e55-45b5-a2c5-dca97e901feb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Going to try to start instance {{(pid=121068) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 00:05:14.666719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-403db03b-5e55-45b5-a2c5-dca97e901feb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/action" status: 202 len: 0 microversion: 2.1 time: 0.227107 Sep 11 00:05:14.667322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 245/500] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:05:14 2022] POST /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:05:14.678169 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:14.680338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:14.689770 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:14.690479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:14.691063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:14.691873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:14.692491 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:14.693077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:14.891283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:14.891906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:14.898383 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:14.898904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:14.899298 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:14.899749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:14.900033 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:14.900484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:14.900900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:14.910452 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-db667f89-23e2-437a-85ec-7182ddd6ebd3 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1662 microversion: 2.1 time: 0.237934 Sep 11 00:05:14.911104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 256/501] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:14 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1662 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:15.025330 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:15.025940 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:15.032202 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:15.032790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:15.033227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:15.033918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:15.034368 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:15.034812 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:15.039710 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:15.047967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-839d439d-a660-4c2e-9754-ede5cd71c468 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.162281 Sep 11 00:05:15.048538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 246/502] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:14 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:15.165235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:15.174101 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d658f4d0-7cf3-4776-8062-e81631e9d3ee tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1318 microversion: 2.1 time: 0.152624 Sep 11 00:05:15.174963 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 257/503] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:15 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:15.947095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:15.950840 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:15.962605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:15.963128 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:15.963567 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:15.964275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:15.964731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:15.965159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:16.072891 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:16.073501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:16.079935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:16.080408 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:16.081029 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:16.081819 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:16.082156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:16.082568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:16.095027 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:16.102914 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6e770def-9bf2-40db-b30f-fda762ed4f5c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1662 microversion: 2.1 time: 0.168615 Sep 11 00:05:16.103775 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 247/504] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:15 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:16.198217 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:16.198835 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:16.207853 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:16.208609 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:16.209045 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:16.209813 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:16.210256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:16.210696 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:16.227237 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:16.237501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6bfe638f-f1d0-40d4-b023-5975e51c778e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.168721 Sep 11 00:05:16.238076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 258/505] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:16 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:16.347637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:16.355167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0bf5c469-d36a-4e0c-8b9f-7b97d17cc71b tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1318 microversion: 2.1 time: 0.161227 Sep 11 00:05:16.356429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 248/506] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:16 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:17.128058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:17.128670 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:17.135153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:17.135631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:17.136064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:17.136744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:17.137865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:17.138284 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:17.262459 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:17.263705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:17.268151 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:17.270202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:17.270708 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:17.271138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:17.271830 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:17.272299 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:17.272717 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:17.276123 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ea368128-b612-404f-a4f9-d05a30ed3135 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1662 microversion: 2.1 time: 0.152131 Sep 11 00:05:17.276752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 259/507] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:17 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:17.378432 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:17.378993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:17.380805 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:17.385390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:17.385871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:17.386301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:17.387281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:17.387873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:17.388351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:17.404506 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:17.412802 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6a218b86-55ab-42b8-a021-f93ac47472c0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.154212 Sep 11 00:05:17.413375 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 249/508] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:17 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:17.518936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:17.526751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7459cf4e-81e8-4d57-a2df-d47d8d17c0bc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1507 microversion: 2.1 time: 0.152539 Sep 11 00:05:17.527308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 260/509] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:17 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:17.549637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "036ff7bf-385b-4fdf-bd82-300d7b74ce90", "device": "/dev/sdb"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:17.552564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:17.561598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:17.562079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:17.562513 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:17.563241 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:17.563689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:17.564112 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:18.299285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:18.299882 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:18.306359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:18.310450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:18.310450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:18.310450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:18.310450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:18.311485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:18.392833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-97a3e78e-b52c-45f8-a4f7-62da3ba5b015 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "POST /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847026 Sep 11 00:05:18.393540 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 250/510] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:05:17 2022] POST /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:05:18.438494 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:18.439444 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:18.446042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:18.447201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:18.447897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:18.448408 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:18.449227 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:18.449921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:18.451134 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:18.454576 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a4f85072-01c3-43e0-b523-aec2fd68d088 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1666 microversion: 2.1 time: 0.159146 Sep 11 00:05:18.455211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 261/511] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:18 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:18.587011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:18.595998 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-db61e0dc-d221-469e-9d90-acf08254af23 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.162670 Sep 11 00:05:18.596586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 251/512] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:18 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:19.155269 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:19.155809 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:19.162031 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:19.162507 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:19.162978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:19.163655 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:19.164096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:19.164508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:19.197459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c0b389e9-e681-462e-92df-3711333e9f14 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments/ab1c9f18-512b-4487-a0fb-1026282e38fe" status: 200 len: 194 microversion: 2.20 time: 0.047090 Sep 11 00:05:19.198140 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 262/513] 10.222.0.17 () {60 vars in 1454 bytes} [Sun Sep 11 00:05:19 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments/ab1c9f18-512b-4487-a0fb-1026282e38fe => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:19.270706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:19.271195 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:19.277418 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:19.277967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:19.286633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:19.286633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:19.286633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:19.286633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:19.363071 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lazy-loading 'services' on Instance uuid b206b090-4c06-4bf1-a005-379f4056da27 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:05:19.520929 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-14384542-57dc-41cd-acb6-f2ff9cfdeb1d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments/ab1c9f18-512b-4487-a0fb-1026282e38fe" status: 202 len: 0 microversion: 2.20 time: 0.253985 Sep 11 00:05:19.521721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 252/514] 10.222.0.17 () {60 vars in 1457 bytes} [Sun Sep 11 00:05:19 2022] DELETE /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments/ab1c9f18-512b-4487-a0fb-1026282e38fe => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:05:19.529897 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:19.532188 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:19.538652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:19.539193 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:19.539628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:19.540317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:19.540760 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:19.541175 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:19.573604 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-98abf194-0d8f-4cce-98ac-d3909caffb1f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047664 Sep 11 00:05:19.574155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 263/515] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:19 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:19.620125 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:19.620815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:19.627248 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:19.627720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:19.628147 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:19.628824 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:19.629267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:19.629682 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:19.766784 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:19.769121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:19.775921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c38d1bbb-2be8-43c7-8c00-e43f592ff594 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.159960 Sep 11 00:05:19.776520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 253/516] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:19 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:20.586090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:20.588285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:20.595545 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:20.596117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:20.596544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:20.597219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:20.597681 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:20.598098 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:20.627565 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4c955b28-7160-4b33-ab61-b85c82114f2f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045419 Sep 11 00:05:20.628112 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 264/517] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:20 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:20.799986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:20.800975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:20.811037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:20.811672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:20.812162 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:20.812865 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:20.813307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:20.813719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:20.948265 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:20.956475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-709d29aa-270f-49be-bfc3-c83470a1a66e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.160925 Sep 11 00:05:20.957074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 254/518] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:20 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:21.639175 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:21.641459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:21.647842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:21.648352 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:21.648791 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:21.649479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:21.649934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:21.650355 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:21.680398 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cc2043bb-b3f1-4da1-a3ce-2237adc17aec tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045219 Sep 11 00:05:21.680943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 265/519] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:21 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:21.980969 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:21.981570 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:21.987981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:21.988448 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:21.988872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:21.989640 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:21.990080 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:21.990491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:22.117720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:22.125865 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-181b02f8-b7b6-4432-8195-0e4b9177ac3b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.148728 Sep 11 00:05:22.126435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 255/520] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:21 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:22.693412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:22.695626 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:22.702256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:22.702880 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:22.703327 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:22.704017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:22.704470 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:22.704894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:22.734195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-79e02768-ed78-48d9-b998-6daf40334a06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044169 Sep 11 00:05:22.734783 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 266/521] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:22 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:23.149467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:23.150079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:23.156984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:23.157466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:23.157901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:23.158582 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:23.159062 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:23.159486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:23.291760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:23.301156 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-59956769-0f3a-48ac-953d-bbfbf158bc22 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.155655 Sep 11 00:05:23.301735 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 256/522] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:23 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:23.746740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:23.748875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:23.756145 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:23.756626 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:23.757057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:23.757861 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:23.758324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:23.758786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:23.774994 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:23.788006 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d7eaec6a-ca3e-4bdf-b056-e13662598eb0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045321 Sep 11 00:05:23.794652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 267/523] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:23 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:24.324526 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:24.325144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:24.331894 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:24.332379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:24.332820 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:24.333506 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:24.333961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:24.334382 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:24.462840 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:24.471257 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f097741b-cd23-4a7b-9393-e979a4474228 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.150860 Sep 11 00:05:24.471828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 257/524] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:24 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:24.805423 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:24.807591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:24.814411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:24.816706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:24.816706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:24.816706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:24.816706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:24.817067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:24.846287 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-88d06ed2-045f-4e72-85f9-101b6e2cc9fb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044826 Sep 11 00:05:24.846862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 268/525] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:24 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:25.494731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:25.495348 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:25.502760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:25.503662 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:25.506637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:25.506637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:25.506637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:25.506637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:25.663374 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:25.672743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9b4526d1-f814-4297-8e4c-a326975b9117 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.181770 Sep 11 00:05:25.673327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 258/526] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:25 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:25.859013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:25.862821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:25.869546 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:25.870129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:25.870722 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:25.871584 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:25.872191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:25.872657 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:25.907428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6284dd8e-7d75-46f9-900d-459974f3eb57 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052374 Sep 11 00:05:25.908011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 269/527] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:25 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:26.697610 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:26.698140 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:26.705539 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:26.706016 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:26.706443 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:26.707145 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:26.707589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:26.708004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:26.835055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:26.843789 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d36c51a2-df47-478a-b10e-985546a7b742 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.150317 Sep 11 00:05:26.844354 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 259/528] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:26 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:26.921009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:26.923227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:26.929520 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:26.929995 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:26.930420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:26.931129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:26.931569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:26.931982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:26.962035 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-90515377-b45b-4643-97b2-92c0b56866c3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044928 Sep 11 00:05:26.962503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 270/529] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:26 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:27.866905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:27.867511 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:27.873861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:27.874734 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:27.875191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:27.875877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:27.876330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:27.876752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:27.975333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:27.977637 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:27.984998 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:27.985487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:27.985924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:27.986635 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:27.987097 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:27.987528 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:28.009138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:28.017973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5add9ed8-973b-4765-ad3e-e867c3999c3e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.154768 Sep 11 00:05:28.018203 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7faf2e00-09b7-4028-b882-044d6fb8c975 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047426 Sep 11 00:05:28.018545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 260/530] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:27 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:28.019476 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 271/531] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:27 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 00:05:29.031458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:29.033724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:29.040199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:29.040680 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:29.041119 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:29.041426 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:29.041993 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:29.042231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:29.042345 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:29.042650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:29.049654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:29.050136 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:29.050564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:29.051274 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:29.051720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:29.052173 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:29.075625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-83b57c33-99c9-4426-8bad-e1eb53d67bbf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049049 Sep 11 00:05:29.076192 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 261/532] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:29 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:29.180608 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:29.189181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-63afaf86-9c45-4152-bcfa-5fb01c4d7ae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.151529 Sep 11 00:05:29.189743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 272/533] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:29 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:30.088343 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:30.090478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:30.097838 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:30.098322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:30.098774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:30.099448 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:30.099888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:30.100302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:30.130400 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ac137e35-21e3-4713-a77e-99175f301216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046041 Sep 11 00:05:30.130898 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 262/534] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:30 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:05:30.213565 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:30.214201 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:30.220923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:30.221408 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:30.221845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:30.222547 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:30.223041 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:30.223470 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:30.368497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:30.377310 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8de60ff1-8d7a-490c-ab77-2b883b0a1b8d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.167515 Sep 11 00:05:30.377852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 273/535] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:30 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:31.143582 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:31.145632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:31.152039 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:31.152510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:31.152943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:31.153614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:31.154054 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:31.154466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:31.182810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-73598a11-70b4-4a71-ba4a-f533e4b02e1c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043885 Sep 11 00:05:31.183348 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 263/536] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:05:31 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:31.257466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:31.258057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:31.264396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:31.265955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:31.266433 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:31.267147 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:31.267601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:31.268022 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:31.293959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:05:31.401323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:31.401862 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:31.408728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:31.409211 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:31.409655 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:31.410347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:31.410827 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:31.411377 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:31.539235 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:31.548778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-db06ebcb-8880-468c-83ca-13bf198aa2da tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.151410 Sep 11 00:05:31.549361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 264/537] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:31 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:31.554995 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9c912266-8c59-46e2-8028-220a40d32835 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 204 len: 0 microversion: 2.20 time: 0.301134 Sep 11 00:05:31.555576 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 274/538] 10.222.0.17 () {60 vars in 1280 bytes} [Sun Sep 11 00:05:31 2022] DELETE /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 11 00:05:31.563635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:31.565847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:31.570127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:31.570598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:31.571327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:31.572033 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:31.572492 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:31.572916 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:31.697454 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:31.705964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:31.707412 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:31.708541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e1bdaeba-a965-4f72-b63a-e1803ff20491 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.148753 Sep 11 00:05:31.709554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 265/539] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:31 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:05:32.574462 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:32.575110 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:32.581996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:32.582474 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:32.582941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:32.583623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:32.584076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:32.584495 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:32.715804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:32.724754 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e9affda1-4385-4fc2-b1d3-b6d9b170cc2e tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.154876 Sep 11 00:05:32.725308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 275/540] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:32 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:32.735385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:32.736017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:32.742466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:32.742975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:32.743404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:32.744079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:32.744521 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:32.744935 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:32.876831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:32.885064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:32.886492 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:32.887664 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5edc6683-dd00-4c67-ae79-303c0b2af784 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.156231 Sep 11 00:05:32.888199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 266/541] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:32 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:33.747953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:33.748564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:33.754975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:33.755454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:33.755886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:33.756568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:33.757024 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:33.757442 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:33.887672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:33.897853 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e8656143-40b6-4c99-812f-3e54af22bae7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.153749 Sep 11 00:05:33.898714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 276/542] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:33 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:33.913841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:33.914275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:33.920357 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:33.920940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:33.921559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:33.922254 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:33.922731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:33.923159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:34.051720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:34.059857 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:34.061378 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:34.063098 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-85bda696-f4fd-4f1a-8de6-6d59c1f8ef13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.153702 Sep 11 00:05:34.063646 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 267/543] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:33 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:34.927558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:34.928157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:34.934484 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:34.934897 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:34.935392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:34.936000 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:34.937108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:34.937531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:35.067172 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:35.075566 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-df3f32a8-59db-4294-afe9-7571f6fd84db tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1734 microversion: 2.1 time: 0.151798 Sep 11 00:05:35.076126 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 277/544] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:34 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:35.089567 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:35.090355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:35.098781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:35.099249 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:35.099794 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:35.100495 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:35.100968 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:35.101380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:35.231481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:35.240641 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:35.242124 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:35.243298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-533fd3d2-39be-467f-a068-f9ebe4429b51 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.158000 Sep 11 00:05:35.243850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 268/545] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:35 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:36.099599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:36.100200 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:36.106550 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.107062 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.107493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.108174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.109751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.110174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.244650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:36.253651 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8a88b0b3-fd23-4760-8491-ea981c200fb5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1714 microversion: 2.1 time: 0.157818 Sep 11 00:05:36.254302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 278/546] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:36 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:36.271272 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:36.272016 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:36.278733 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.288924 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.289389 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.290129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.290588 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.291177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.373847 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:36.374893 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:36.382001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.382843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.383722 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.384603 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.385399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.385879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.435703 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:36.444600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:36.446150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:36.447718 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a812b5a6-5c3d-49b4-9f2c-89e07735bcbe tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1722 microversion: 2.20 time: 0.180415 Sep 11 00:05:36.448779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 269/547] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:36 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:36.518373 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] HTTP exception thrown: Cannot 'detach_volume' instance c65cfc71-51a9-461d-a845-b46e71080e92 while it is in vm_state rescued Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Request method failure captured: Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments/8f4834f8-6bb2-4505-824f-c80d25249b7b HTTP/1.1 Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVFGZAiyc7PEdHjnPTpZKE5_yItwy5vPJHcwOPgr5_CjblTSvJNtfk4L2GFcbhaf7T50zcH-bmVBQ7tER7-WwV0lDH4ju7hO0sOUPUYkSld0V4_GqymUN6XoGtdnxK-4hbpYd6s8bSl8h0NMkvxI2kuILXo4ydne9C-3jhQm-3MLV0 Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:05:36.520082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0b35b1c14ba4a2e9b23a223628b449c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}] Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: b8ceeb13c4c24ceb9ff1f27b4e45f62c Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:05:36.523369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Cannot 'detach_volume' instance c65cfc71-51a9-461d-a845-b46e71080e92 while it is in vm_state rescued Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'server_id': 'c65cfc71-51a9-461d-a845-b46e71080e92', 'id': '8f4834f8-6bb2-4505-824f-c80d25249b7b'} Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c65cfc71-51a9-461d-a845-b46e71080e92 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:05:36.524038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c65cfc71-51a9-461d-a845-b46e71080e92 while it is in vm_state rescued Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c65cfc71-51a9-461d-a845-b46e71080e92 while it is in vm_state rescued Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:36.525332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Returning 409 to user: Cannot 'detach_volume' instance c65cfc71-51a9-461d-a845-b46e71080e92 while it is in vm_state rescued {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:05:36.526303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e84e113f-ca42-4df2-8586-80b1eabeaf7f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments/8f4834f8-6bb2-4505-824f-c80d25249b7b" status: 409 len: 152 microversion: 2.1 time: 0.151825 Sep 11 00:05:36.526303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 279/548] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:05:36 2022] DELETE /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments/8f4834f8-6bb2-4505-824f-c80d25249b7b => generated 152 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 11 00:05:36.531011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:36.531532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:36.537635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.538112 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.538544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.539249 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.539943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.540097 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.554070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:36.774313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f9c80053-61df-4701-9899-0012e2f966e9 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "POST /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/action" status: 202 len: 0 microversion: 2.1 time: 0.247334 Sep 11 00:05:36.780199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 270/549] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:05:36 2022] POST /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:05:36.790238 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:36.791038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:36.797907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.798433 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.799112 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:36.799844 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:36.800295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:36.800934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:37.099792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:37.108390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-38ee9cdc-22d4-4784-9043-7e5962aa3f36 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1722 microversion: 2.1 time: 0.324840 Sep 11 00:05:37.109001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 280/550] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:36 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:37.478087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:37.479011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:37.481534 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=76 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:37.487750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:37.488335 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:37.488836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:37.489782 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:37.490167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:37.490593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:37.559180 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:37.568172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:37.569632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:37.570866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d3c91a35-44d6-4951-a18d-91441393afe0 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1655 microversion: 2.20 time: 0.097044 Sep 11 00:05:37.571704 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 271/551] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:37 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:38.039146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-391d1070-5e6a-448e-98eb-09ed9e913627 req-e5947c13-74ea-42b6-8787-778e2d8956f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b206b090-4c06-4bf1-a005-379f4056da27", "name": "network-vif-deleted", "tag": "13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:38.060175 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-391d1070-5e6a-448e-98eb-09ed9e913627 req-e5947c13-74ea-42b6-8787-778e2d8956f7 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:38.061042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-391d1070-5e6a-448e-98eb-09ed9e913627 req-e5947c13-74ea-42b6-8787-778e2d8956f7 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:38.062527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-391d1070-5e6a-448e-98eb-09ed9e913627 req-e5947c13-74ea-42b6-8787-778e2d8956f7 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:38.077752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-391d1070-5e6a-448e-98eb-09ed9e913627 req-e5947c13-74ea-42b6-8787-778e2d8956f7 service nova] Creating event network-vif-deleted:13fe814e-d80a-4bbf-84ea-a89b1c6b5fd1 for instance b206b090-4c06-4bf1-a005-379f4056da27 on hv-cinder-85200 Sep 11 00:05:38.083827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-391d1070-5e6a-448e-98eb-09ed9e913627 req-e5947c13-74ea-42b6-8787-778e2d8956f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049409 Sep 11 00:05:38.084586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 281/552] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:05:38.132159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:38.133242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:38.140844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:38.141650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:38.143069 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:38.143069 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:38.143769 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:38.144199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:38.495700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:38.497013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:38.512883 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:38.513771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:38.514970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:38.517661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:38.518293 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:38.518954 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:38.538527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:38.548336 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-625f8ede-ac38-4d0f-84f0-2575ae96a2bd tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1722 microversion: 2.1 time: 0.420493 Sep 11 00:05:38.565518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 272/553] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:38 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1722 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:38.598122 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:38.599087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:38.605543 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:38.606793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:38.606793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:38.607578 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:38.609439 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:38.615566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:38.619877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lazy-loading 'services' on Instance uuid ec7237ee-323d-4b9b-81d0-a14abcd0dca9 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:05:38.657690 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:38.664554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:38.664554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:38.664554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lazy-loading 'fault' on Instance uuid b206b090-4c06-4bf1-a005-379f4056da27 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:05:38.681981 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:38.703206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:38.711475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:38.712907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:38.714063 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-83aa788f-0c24-4215-af08-b17645aefed2 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1371 microversion: 2.20 time: 0.120662 Sep 11 00:05:38.728291 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 273/554] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:38 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:05:38.872306 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-10e443c9-d0e2-4f9c-b8e3-9119efe29d2f tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9/os-volume_attachments/036ff7bf-385b-4fdf-bd82-300d7b74ce90" status: 202 len: 0 microversion: 2.1 time: 0.382161 Sep 11 00:05:38.872938 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 282/555] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:05:38 2022] DELETE /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9/os-volume_attachments/036ff7bf-385b-4fdf-bd82-300d7b74ce90 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:05:39.573630 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:39.574232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:39.581030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:39.581434 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:39.581861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:39.582541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:39.583014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:39.583426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:39.725580 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:39.735008 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1e44b651-d523-43b5-b931-1c7d776ae5a7 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1722 microversion: 2.1 time: 0.165449 Sep 11 00:05:39.736020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 274/556] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:39 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:39.741625 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:39.742333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:39.749587 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:39.750183 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:39.750626 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:39.752285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:39.752783 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:39.753561 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:39.794582 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:39.795099 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:39.795536 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:39.796867 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lazy-loading 'fault' on Instance uuid b206b090-4c06-4bf1-a005-379f4056da27 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:05:39.842051 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:39.851971 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:39.853821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:39.855087 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-62c502d8-f0c4-46dc-ad09-8e0299abe4b8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1371 microversion: 2.20 time: 0.117798 Sep 11 00:05:39.870805 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 283/557] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:39 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:40.758264 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:40.758905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:40.765750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:40.766230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:40.768132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:40.768132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:40.768132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:40.768446 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:40.880973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:40.881580 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:40.888201 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:40.888687 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:40.889122 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:40.889890 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:40.890561 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:40.891012 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:40.906434 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:40.914765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-36868aee-ebd1-4287-8f0a-be9b9773fbd2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1728 microversion: 2.1 time: 0.160238 Sep 11 00:05:40.915338 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 275/558] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:40 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:40.923181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:40.923666 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:40.924194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:40.924636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lazy-loading 'fault' on Instance uuid b206b090-4c06-4bf1-a005-379f4056da27 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:05:40.942356 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:40.942959 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:40.949205 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:40.949758 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:40.950195 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:40.950900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:40.951408 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:40.951830 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:40.966005 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:40.974380 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:40.975900 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:40.977027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5ba46cb7-6195-4652-88df-ac4d97305226 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 200 len: 1371 microversion: 2.20 time: 0.099991 Sep 11 00:05:40.977814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 284/559] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:40 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:05:41.031942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-875ae557-ea87-4a42-9c6b-b51aad31c868 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093438 Sep 11 00:05:41.032532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 276/560] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Sep 11 00:05:40 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:05:42.003313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:42.003929 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:42.004364 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-7c3db2f2-5767-4988-b041-80767d1f6703 req-8469dfee-90c7-4147-b394-205da74fc67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65cfc71-51a9-461d-a845-b46e71080e92", "tag": "d1ad97b5-d674-4dfa-b8e0-dd3bb492e819"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:42.012222 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:42.013965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:42.014348 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-7c3db2f2-5767-4988-b041-80767d1f6703 req-8469dfee-90c7-4147-b394-205da74fc67f service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:42.015488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:42.015697 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-7c3db2f2-5767-4988-b041-80767d1f6703 req-8469dfee-90c7-4147-b394-205da74fc67f service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:42.016485 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-7c3db2f2-5767-4988-b041-80767d1f6703 req-8469dfee-90c7-4147-b394-205da74fc67f service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:42.016747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:42.017214 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:42.017720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:42.029356 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-7c3db2f2-5767-4988-b041-80767d1f6703 req-8469dfee-90c7-4147-b394-205da74fc67f service nova] Creating event network-changed:d1ad97b5-d674-4dfa-b8e0-dd3bb492e819 for instance c65cfc71-51a9-461d-a845-b46e71080e92 on hv-cinder-85200 Sep 11 00:05:42.033481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] HTTP exception thrown: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:05:42.035223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-7c3db2f2-5767-4988-b041-80767d1f6703 req-8469dfee-90c7-4147-b394-205da74fc67f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036037 Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Request method failure captured: Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 HTTP/1.1 Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVHlua8t6Ni2REZ1FvZtYnnRm5tvuK-y-0C9IjKrZMk7lq6wz9ZZUSrELXLDPA9ItdXt4Y3br-Ovhh6snmEGufsWjRpYmcmnsp3itd-kdQV8PQUyBAKTrqM7kMLbqA0PDBkJfCHK6VjM4Nt72d5HSZjREDOhZvC-SnZ7Kje4jsVffg Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:05:42.039071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c3ed6ff48b44385acef77c00e631b6e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}] Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: a66188ce11bc403d9c657efd78f3019a Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:05:42.041149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'b206b090-4c06-4bf1-a005-379f4056da27'} Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:05:42.042077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:05:42.043586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:42.044934 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 277/561] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:05:42.045030 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Returning 404 to user: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:05:42.045030 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e20a9d87-e401-4ee2-9e9e-7b5f228e9569 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 404 len: 111 microversion: 2.20 time: 0.038240 Sep 11 00:05:42.045030 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 285/562] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:41 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:05:42.047034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c1c9ae5f-6814-4423-8955-c80bbb6b6856 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '.version_select at 0x7f5ab6717820>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:42.133972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c1c9ae5f-6814-4423-8955-c80bbb6b6856 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381593336" status: 204 len: 0 microversion: 2.20 time: 0.091316 Sep 11 00:05:42.141740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 278/563] 10.222.0.17 () {60 vars in 1262 bytes} [Sun Sep 11 00:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381593336 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 00:05:42.148936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:42.149605 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:42.156249 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:42.156742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:42.157482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:42.158413 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:42.158843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:42.159269 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:42.191715 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:05:42.589513 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e0efd088-44fd-46dd-9a4a-6bc64614ccdc tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 204 len: 0 microversion: 2.1 time: 0.444683 Sep 11 00:05:42.590340 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 286/564] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:05:42 2022] DELETE /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:05:42.599007 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:42.605587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:42.606780 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:42.607267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:42.607703 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:42.610132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:42.610521 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:42.611454 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:42.756082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:42.764163 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5aa24010-d818-4c6b-8e56-0c430afa1e4e tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1513 microversion: 2.1 time: 0.169015 Sep 11 00:05:42.764810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 279/565] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:42 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:43.016612 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d32ae957-af68-4b3d-98bf-8438fc819a30 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'create', calling method: .version_select at 0x7f5ab6ae2280>, body: {"keypair": {"name": "tempest-keypair-46702388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9c90Z3a0yCOWiyls6Ylqn+VqEqsPUjoxpo6BcFn5YWjzi9e3klHskBGELtmXVZw7h1+GGkeh9YE0bjK65spkQaocSjTpq8fkHxk31FgBmr5FGP7PasssASnQy+Wmp4oQ=="}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:43.032840 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-d32ae957-af68-4b3d-98bf-8438fc819a30 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Getting quotas for project 1c3ed6ff48b44385acef77c00e631b6e. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:05:43.036615 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-d32ae957-af68-4b3d-98bf-8438fc819a30 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Getting quotas for user a66188ce11bc403d9c657efd78f3019a and project 1c3ed6ff48b44385acef77c00e631b6e. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:05:43.110170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d32ae957-af68-4b3d-98bf-8438fc819a30 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.098473 Sep 11 00:05:43.110768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 287/566] 10.222.0.17 () {62 vars in 1200 bytes} [Sun Sep 11 00:05:43 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 00:05:43.787512 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:43.788165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:43.794629 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:43.795117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:43.795552 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:43.796815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:43.797266 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:43.797688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:43.929764 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:43.935494 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4a66c48d-3022-4d67-9d0e-c691756f3114 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1513 microversion: 2.1 time: 0.152099 Sep 11 00:05:43.936052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 280/567] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:43 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:44.050051 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-4ab052c8-d4f2-4465-bfb8-9733b8f9f562 req-1f413876-3765-42f1-a7c8-c4a390a7ba1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65cfc71-51a9-461d-a845-b46e71080e92", "tag": "d1ad97b5-d674-4dfa-b8e0-dd3bb492e819"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:44.059856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-4ab052c8-d4f2-4465-bfb8-9733b8f9f562 req-1f413876-3765-42f1-a7c8-c4a390a7ba1b service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:44.060324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-4ab052c8-d4f2-4465-bfb8-9733b8f9f562 req-1f413876-3765-42f1-a7c8-c4a390a7ba1b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:44.060820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-4ab052c8-d4f2-4465-bfb8-9733b8f9f562 req-1f413876-3765-42f1-a7c8-c4a390a7ba1b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:44.071809 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-4ab052c8-d4f2-4465-bfb8-9733b8f9f562 req-1f413876-3765-42f1-a7c8-c4a390a7ba1b service nova] Creating event network-changed:d1ad97b5-d674-4dfa-b8e0-dd3bb492e819 for instance c65cfc71-51a9-461d-a845-b46e71080e92 on hv-cinder-85200 Sep 11 00:05:44.076610 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-4ab052c8-d4f2-4465-bfb8-9733b8f9f562 req-1f413876-3765-42f1-a7c8-c4a390a7ba1b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031340 Sep 11 00:05:44.077248 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 288/568] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:05:44.960455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:44.961804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:44.969084 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:44.970231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:44.970845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:44.971634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:44.972152 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:44.972743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:45.149964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:45.160157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b5f545a9-31d5-4bea-84de-0e49129ce921 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1513 microversion: 2.1 time: 0.203907 Sep 11 00:05:45.165275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 281/569] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:44 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:45.377384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2041577149", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04880d1e-67f2-4152-a6c8-ba0d1911b4f5"}], "security_groups": [{"name": "tempest-securitygroup--1423617628"}], "key_name": "tempest-keypair-46702388", "user_data": "}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:45.535175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-f604cfdd-b85f-4ec8-9fb5-24c3873543ca req-5af93c97-7c90-4b0f-a40b-851445865574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec7237ee-323d-4b9b-81d0-a14abcd0dca9", "name": "network-vif-deleted", "tag": "6b7bd61b-3ef7-4cb7-aee5-38920b000863"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:45.544121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f604cfdd-b85f-4ec8-9fb5-24c3873543ca req-5af93c97-7c90-4b0f-a40b-851445865574 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:45.544592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f604cfdd-b85f-4ec8-9fb5-24c3873543ca req-5af93c97-7c90-4b0f-a40b-851445865574 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:45.545049 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f604cfdd-b85f-4ec8-9fb5-24c3873543ca req-5af93c97-7c90-4b0f-a40b-851445865574 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:45.559148 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-f604cfdd-b85f-4ec8-9fb5-24c3873543ca req-5af93c97-7c90-4b0f-a40b-851445865574 service nova] Creating event network-vif-deleted:6b7bd61b-3ef7-4cb7-aee5-38920b000863 for instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 on hv-cinder-85200 Sep 11 00:05:45.567858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-f604cfdd-b85f-4ec8-9fb5-24c3873543ca req-5af93c97-7c90-4b0f-a40b-851445865574 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038780 Sep 11 00:05:45.568626 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 282/570] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:05:45.578075 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] validate_networks() for [('04880d1e-67f2-4152-a6c8-ba0d1911b4f5', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:05:45.960062 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:05:45.960523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:05:45.960985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:05:45.961384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:05:45.961785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:05:45.972705 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:45.973193 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:45.973626 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:45.974374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:45.974851 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:45.975277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:45.993390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Getting quotas for project 1c3ed6ff48b44385acef77c00e631b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:05:45.997342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Getting quotas for user a66188ce11bc403d9c657efd78f3019a and project 1c3ed6ff48b44385acef77c00e631b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:05:46.009700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:05:46.012114 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:05:46.032821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:46.119948 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7d51972e-ee7c-43fc-92f2-e8fe48d7edc4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.746383 Sep 11 00:05:46.119948 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 289/571] 10.222.0.17 () {62 vars in 1188 bytes} [Sun Sep 11 00:05:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 00:05:46.132131 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9c220084-e447-4074-bd25-ee7737a78225 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:46.132991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9c220084-e447-4074-bd25-ee7737a78225 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:46.184542 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:46.185273 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:46.193035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9c220084-e447-4074-bd25-ee7737a78225 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:46.195239 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:46.195698 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:46.196124 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:46.197074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:46.197515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:46.197935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:46.201734 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9c220084-e447-4074-bd25-ee7737a78225 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:46.203357 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9c220084-e447-4074-bd25-ee7737a78225 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:46.204490 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9c220084-e447-4074-bd25-ee7737a78225 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1280 microversion: 2.20 time: 0.076762 Sep 11 00:05:46.217637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 283/572] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:46 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:46.231544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:46.232027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:46.232457 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:46.232896 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lazy-loading 'fault' on Instance uuid ec7237ee-323d-4b9b-81d0-a14abcd0dca9 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:05:46.282214 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017684196c8e49e0894d38daf83bfaeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa03f6136eb640ad803659779ce1b085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:46.289951 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-186d6bd8-6ed5-4e1e-97d1-19571f63b5c8 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 200 len: 1308 microversion: 2.1 time: 0.109458 Sep 11 00:05:46.290506 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 290/573] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:46 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:47.234087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:47.234719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:47.242529 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:47.243053 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:47.243486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:47.244255 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:47.244651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:47.245067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:47.306686 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:47.313449 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:47.314063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] [instance: ec7237ee-323d-4b9b-81d0-a14abcd0dca9] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:47.315295 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:47.316719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:47.317816 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7c15cb39-dbbe-4efa-8d73-5d88c8e9adaf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1284 microversion: 2.20 time: 0.088383 Sep 11 00:05:47.318384 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 284/574] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:47 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:47.323544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:47.323544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:47.323544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:47.323544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:47.323885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:47.323885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:47.343397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] HTTP exception thrown: Instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 could not be found. Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Request method failure captured: Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 HTTP/1.1 Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSXNVxLlRui4krsAlalKZ35Wsx34JcRdococ3S-v9c9yqWr_rUkALejK5s4mESSxi2PIvKmBKn-wjMiUA_ivGndVvW7y6EjuoBIGhYJ3SkO4aqvtAL2AkzSNSoNs28q7w9MVHJZhUoe_8RxMqDLn_EbwtwCNSVKSGU_4Ui4Z7nEC_08 Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: fa03f6136eb640ad803659779ce1b085 Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-VolumesSnapshotTestJSON-469934344 Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:05:47.345419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa03f6136eb640ad803659779ce1b085", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa03f6136eb640ad803659779ce1b085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa03f6136eb640ad803659779ce1b085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa03f6136eb640ad803659779ce1b085"}]}] Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-VolumesSnapshotTestJSON-469934344 Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: fa03f6136eb640ad803659779ce1b085 Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-469934344 Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-VolumesSnapshotTestJSON-469934344-project Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 017684196c8e49e0894d38daf83bfaeb Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-VolumesSnapshotTestJSON-469934344-project Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 could not be found. Sep 11 00:05:47.348142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'ec7237ee-323d-4b9b-81d0-a14abcd0dca9'} Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 could not be found. Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:05:47.358793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 could not be found. Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 could not be found. Sep 11 00:05:47.362374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:05:47.364421 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] Returning 404 to user: Instance ec7237ee-323d-4b9b-81d0-a14abcd0dca9 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:05:47.364421 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5882d4cd-746a-4877-be85-90efbbadeee4 tempest-VolumesSnapshotTestJSON-469934344 tempest-VolumesSnapshotTestJSON-469934344-project] 10.222.0.17 "GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9" status: 404 len: 111 microversion: 2.1 time: 0.037928 Sep 11 00:05:47.364421 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 291/575] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:47 2022] GET /compute/v2.1/servers/ec7237ee-323d-4b9b-81d0-a14abcd0dca9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:05:48.343936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:48.344794 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:48.351975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:48.352836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:48.353599 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:48.355144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:48.355971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:48.356766 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:48.431481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:48.439658 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:48.441099 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:48.442189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ba790ee0-c6ea-4cc6-886a-63ff4da3e109 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1340 microversion: 2.20 time: 0.102486 Sep 11 00:05:48.442973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 285/576] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:48 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:49.481754 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:49.482460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:49.489703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:49.490181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:49.490610 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:49.491331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:49.491774 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:49.492192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:49.699080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:49.707854 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:49.709178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:49.710267 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-06bf25a0-6e2a-4b9a-81ac-6d8d87893b89 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.232702 Sep 11 00:05:49.710833 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 292/577] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:49 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:50.136469 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-5cfc4af9-e957-4d39-85d4-79676bd3b0f2 req-201f7655-9580-4881-9691-d7c4359e2bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede54ea4-13f8-4bf2-bba7-8291c078c1c8", "tag": "3a2fb6f5-4c77-4613-a8e9-31df96539e3d"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:50.146285 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-5cfc4af9-e957-4d39-85d4-79676bd3b0f2 req-201f7655-9580-4881-9691-d7c4359e2bb6 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:50.146773 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-5cfc4af9-e957-4d39-85d4-79676bd3b0f2 req-201f7655-9580-4881-9691-d7c4359e2bb6 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:50.147191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-5cfc4af9-e957-4d39-85d4-79676bd3b0f2 req-201f7655-9580-4881-9691-d7c4359e2bb6 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:50.158343 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-5cfc4af9-e957-4d39-85d4-79676bd3b0f2 req-201f7655-9580-4881-9691-d7c4359e2bb6 service nova] Creating event network-changed:3a2fb6f5-4c77-4613-a8e9-31df96539e3d for instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 on hv-cinder-85200 Sep 11 00:05:50.163081 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-5cfc4af9-e957-4d39-85d4-79676bd3b0f2 req-201f7655-9580-4881-9691-d7c4359e2bb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030364 Sep 11 00:05:50.163660 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 286/578] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:05:50.736415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:50.737026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:50.743411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:50.743893 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:50.744326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:50.745006 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:50.745455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:50.745880 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:50.877945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:50.886152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:50.887606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:50.888760 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9ef005a4-771e-41ed-b1ed-2504b0499314 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.156595 Sep 11 00:05:50.889315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 293/579] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:50 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:51.915284 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:51.915975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:51.922559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:51.923309 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:51.923731 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:51.924418 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:51.924867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:51.925289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:52.052892 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:52.061411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:52.062899 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:52.064131 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-22da6777-44be-4856-82bf-bf150cffadb4 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.153186 Sep 11 00:05:52.064695 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 287/580] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:51 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:53.089562 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:53.090266 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:53.097080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:53.097556 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:53.098019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:53.098758 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:53.099214 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:53.099634 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:53.243691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:53.252310 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:53.253759 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:53.255258 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-21dc8e1f-78e4-449b-8322-b4dc787311b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.169233 Sep 11 00:05:53.255518 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 294/581] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:53 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:54.280801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:54.281503 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:54.290411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:54.290411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:54.290411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:54.290411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:54.290807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:54.291154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:54.423753 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:54.432231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:54.433735 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:54.434866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-245c6fba-ccc9-4cd1-b230-dfb98561425e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.158123 Sep 11 00:05:54.435419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 288/582] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:54 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:55.460324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:55.460936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:55.467325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:55.467808 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:55.468245 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:55.468935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:55.469389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:55.469813 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:55.600842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:55.608974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:55.610497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:55.611661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-12ee852c-deeb-417f-987d-847d2b32705f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.155674 Sep 11 00:05:55.612482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 295/583] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:55 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:56.636282 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:56.636992 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:56.639569 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:56.644862 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:56.645342 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:56.645835 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:56.646520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:56.647000 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:56.647421 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:56.828170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:56.830342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:56.832281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:56.832945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=10 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:56.838046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:56.838521 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:56.838985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:56.839668 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:56.840111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:56.840527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:56.871578 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-709396ee-adf9-4883-8521-13adfdd7d4fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047321 Sep 11 00:05:56.872071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 296/584] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:05:56 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 11 00:05:56.941771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:56.942390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:56.948827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:56.949482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:56.954795 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:56.954795 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:56.954795 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:56.954795 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:56.961536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:56.969635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:56.971325 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:56.972534 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bfb065b0-e306-4c2f-b24a-d32c3fcdb305 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.340125 Sep 11 00:05:56.973099 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 289/585] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:56 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:56.995080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:05:57.309658 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e7d2475d-d771-4b25-bdb4-8f5601470ce9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 204 len: 0 microversion: 2.1 time: 0.372604 Sep 11 00:05:57.310248 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 297/586] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:05:56 2022] DELETE /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:05:57.319010 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:57.319687 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:57.325965 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:57.326442 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:57.326911 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:57.327599 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:57.328048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:57.328467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:57.332447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:57.460017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:57.467540 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2c6c9645-f154-405e-8c31-c6b80850ae8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1672 microversion: 2.1 time: 0.152990 Sep 11 00:05:57.468101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 290/587] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:57 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:05:57.999209 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:57.999881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:58.006166 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:58.006706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:58.007140 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:58.007812 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:58.008255 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:58.008668 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:58.027800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:05:58.200669 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:58.215826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:58.217302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:58.218592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d8d02fd6-8648-4f6c-bcc0-010730c59bb6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.223709 Sep 11 00:05:58.219174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 298/588] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:57 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:58.492540 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:58.493281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:58.500074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:58.500549 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:58.501019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:58.501703 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:58.502146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:58.503335 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:58.639300 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:58.648118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d3146f5d-a78f-41c6-959e-a2119c93a830 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1672 microversion: 2.1 time: 0.159831 Sep 11 00:05:58.648769 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 291/589] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:58 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:05:58.684066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-269f4abe-851e-448c-ac59-55e7d4686509 req-f96e4e8d-940e-47cf-8529-d5e35578b020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede54ea4-13f8-4bf2-bba7-8291c078c1c8", "name": "network-vif-plugged", "status": "completed", "tag": "3a2fb6f5-4c77-4613-a8e9-31df96539e3d"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:05:58.694263 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-269f4abe-851e-448c-ac59-55e7d4686509 req-f96e4e8d-940e-47cf-8529-d5e35578b020 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:58.694837 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-269f4abe-851e-448c-ac59-55e7d4686509 req-f96e4e8d-940e-47cf-8529-d5e35578b020 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:58.695272 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-269f4abe-851e-448c-ac59-55e7d4686509 req-f96e4e8d-940e-47cf-8529-d5e35578b020 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:58.706232 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-269f4abe-851e-448c-ac59-55e7d4686509 req-f96e4e8d-940e-47cf-8529-d5e35578b020 service nova] Creating event network-vif-plugged:3a2fb6f5-4c77-4613-a8e9-31df96539e3d for instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 on hv-cinder-85200 Sep 11 00:05:58.711044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-269f4abe-851e-448c-ac59-55e7d4686509 req-f96e4e8d-940e-47cf-8529-d5e35578b020 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030629 Sep 11 00:05:58.711620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 299/590] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:05:59.244524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:59.245126 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:59.251107 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:59.251595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:59.252010 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:59.253388 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:59.254026 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:59.254451 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:59.386912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:59.396016 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:59.397445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:59.398576 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-35b30618-6875-4903-8c31-f62a3df2b8f6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.157972 Sep 11 00:05:59.399164 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 292/591] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:05:59 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:05:59.672675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:05:59.673364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:05:59.680112 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:59.680586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:59.681018 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:59.681694 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:05:59.682139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:05:59.682553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:05:59.810130 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:05:59.817953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-76ca3a76-2cae-46ed-a9ab-cadc28218926 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1672 microversion: 2.1 time: 0.150172 Sep 11 00:05:59.818517 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 300/592] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:05:59 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:00.422636 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:00.423356 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:00.430204 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:00.430706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:00.431144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:00.431829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:00.432275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:00.432697 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:00.561056 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:00.569321 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:00.570797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:00.572164 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-76e89f75-5629-4d28-8970-57479dd2575f tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.153201 Sep 11 00:06:00.572720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 293/593] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:00 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:00.842065 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:00.842593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:00.849684 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:00.850157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:00.850589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:00.851289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:00.851733 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:00.852175 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:00.986104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:00.993809 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-beec6ca3-7c46-4ddb-a53f-8fcc258dccda tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1672 microversion: 2.1 time: 0.155707 Sep 11 00:06:00.994361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 301/594] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:00 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:01.598005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:01.598607 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:01.604938 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:01.605410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:01.605839 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:01.606512 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:01.606981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:01.607398 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:01.738233 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:01.746221 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:01.747689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:01.748816 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-980d5c26-48fe-4dae-b521-3e5be667243e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.154636 Sep 11 00:06:01.749373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 294/595] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:01 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:02.018259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:02.018934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:02.025542 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:02.026021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:02.026455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:02.027217 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:02.027668 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:02.028086 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:02.165858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:02.175691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-abfb0354-b726-451d-b097-c05a8585c80c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1672 microversion: 2.1 time: 0.161952 Sep 11 00:06:02.176461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 302/596] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:02 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:02.774213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:02.774840 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:02.781445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:02.782562 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:02.782562 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:02.783332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:02.784398 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:02.784829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:02.917784 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:02.926315 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:02.927773 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:02.928867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-aa37bcd6-64d1-4981-b78f-98fd9365c87e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.158608 Sep 11 00:06:02.929416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 295/597] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:02 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:03.210563 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:03.212787 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:03.229271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:03.235804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:03.235804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:03.235804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:03.235804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:03.236148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:03.321693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:03.328325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2be655a3-e887-475c-90b7-0a6de5ff8caa tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1605 microversion: 2.1 time: 0.130907 Sep 11 00:06:03.328899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 303/598] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:03 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1605 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:03.507172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-e219aff1-3986-4bd4-9820-6c2072a1fcc8 req-ab50b9cf-8aef-457d-ba1f-b02f55f9f770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890c9ef2-f830-4f13-a0c4-53dfb10e08c0", "name": "network-vif-deleted", "tag": "15a31cd2-b0f9-4ce0-a5d5-969cde3d23aa"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:03.516778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-e219aff1-3986-4bd4-9820-6c2072a1fcc8 req-ab50b9cf-8aef-457d-ba1f-b02f55f9f770 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:03.517276 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-e219aff1-3986-4bd4-9820-6c2072a1fcc8 req-ab50b9cf-8aef-457d-ba1f-b02f55f9f770 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:03.517726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-e219aff1-3986-4bd4-9820-6c2072a1fcc8 req-ab50b9cf-8aef-457d-ba1f-b02f55f9f770 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:03.531326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-e219aff1-3986-4bd4-9820-6c2072a1fcc8 req-ab50b9cf-8aef-457d-ba1f-b02f55f9f770 service nova] Creating event network-vif-deleted:15a31cd2-b0f9-4ce0-a5d5-969cde3d23aa for instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 on hv-cinder-85200 Sep 11 00:06:03.538260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-e219aff1-3986-4bd4-9820-6c2072a1fcc8 req-ab50b9cf-8aef-457d-ba1f-b02f55f9f770 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035559 Sep 11 00:06:03.539958 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 296/599] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:03.954111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:03.954628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:03.960777 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:03.961252 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:03.961677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:03.962348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:03.962813 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:03.963227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:04.099508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:04.107864 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:04.109382 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:04.110606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fc276b36-4a9c-4a8e-81c4-5c599dfbfd48 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1406 microversion: 2.20 time: 0.160503 Sep 11 00:06:04.113890 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 304/600] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:03 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:04.352979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:04.356190 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:04.362115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:04.363048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:04.363719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:04.365118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:04.366228 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:04.366902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:04.403090 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:04.403657 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:04.404317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:04.405165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lazy-loading 'fault' on Instance uuid 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:06:04.464046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:04.476837 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e9e3a5d0-0ce0-4c0a-9735-c346703f6b9d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 200 len: 1327 microversion: 2.1 time: 0.128276 Sep 11 00:06:04.477341 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 297/601] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:04 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:05.137316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:05.137943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:05.144713 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:05.145451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:05.145706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:05.146396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:05.146934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:05.147355 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:05.281824 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:05.290166 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:05.291636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:05.292815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3bdb7983-9743-4537-b25a-a58f594252fc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1597 microversion: 2.20 time: 0.159437 Sep 11 00:06:05.293374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 305/602] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:05 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:05.318891 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:05.319377 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:05.325527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:05.326056 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:05.326478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:05.327174 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:05.327771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:05.328191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:05.407027 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-465196a6-3a3e-4325-bcb7-0825d3a4879d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092631 Sep 11 00:06:05.407650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 298/603] 10.222.0.17 () {60 vars in 1316 bytes} [Sun Sep 11 00:06:05 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:06:05.506264 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:05.507078 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:05.513323 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:05.513806 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:05.514235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:05.514969 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:05.515416 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:05.515866 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:05.530581 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] HTTP exception thrown: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Request method failure captured: Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 HTTP/1.1 Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVDz39WI8zSFD3sAxjj3AauZVU_YuIF61kZ9zSVTuvhSWeCR_4FJKf132MV4J6IpQlpIwvHoVlNnJhyEI1e7wpiNct6lt4c1TfyVx1bN2Gr_1RtrQHP1Qz08ttHxVn_uXjY45Jkz8-I6eAKw0vCLkrDy2z8MQ4SuqYY-aMRjURVXkQ Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:06:05.532187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_65f0209a8e48496c8d88c885f8364cbd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}] Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 9950f578162449c0845c3aa4aab692d4 Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:06:05.533751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '890c9ef2-f830-4f13-a0c4-53dfb10e08c0'} Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:06:05.534654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:06:05.535875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:06:05.536932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Returning 404 to user: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:06:05.536932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-860a5d5b-eda1-42bf-a903-e8e2849dcb68 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 404 len: 111 microversion: 2.1 time: 0.031883 Sep 11 00:06:05.536932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 306/604] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:05 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:06:05.542932 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-68a22a36-8048-4eb7-97c7-cdbc4c9b98ad tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '.version_select at 0x7f5ab69dc280>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:05.613973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-68a22a36-8048-4eb7-97c7-cdbc4c9b98ad tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830820755" status: 202 len: 0 microversion: 2.1 time: 0.074852 Sep 11 00:06:05.614564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 299/605] 10.222.0.17 () {58 vars in 1221 bytes} [Sun Sep 11 00:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830820755 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:06:06.453480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a2461145-95d8-4f88-aaef-478134a6c001 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'create', calling method: .version_select at 0x7f5ab69e15e0>, body: {"keypair": {"name": "tempest-keypair-365299840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1Y51BZzs4Ujx+4/uCRqf58HgHLbwfLP6l9GvWWKqBitXNcOGSGJ+Zcd2Sa2+ocmkz4AonuxPExZRGjCmEy/Vv4DP/YJFAxtfZm+xs7bGcKN5Y9zyfCr7+BXByfV7Dg0Q=="}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:06.472319 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-a2461145-95d8-4f88-aaef-478134a6c001 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Getting quotas for project 65f0209a8e48496c8d88c885f8364cbd. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:06:06.476548 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-a2461145-95d8-4f88-aaef-478134a6c001 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Getting quotas for user 9950f578162449c0845c3aa4aab692d4 and project 65f0209a8e48496c8d88c885f8364cbd. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:06:06.561154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a2461145-95d8-4f88-aaef-478134a6c001 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111329 Sep 11 00:06:06.561825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 307/606] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:06:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:06.692712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-19c938a0-fc59-4eed-90c7-be7991f97ce3 req-d5926f33-7dd2-451f-bd3f-469130d16acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede54ea4-13f8-4bf2-bba7-8291c078c1c8", "tag": "3a2fb6f5-4c77-4613-a8e9-31df96539e3d"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:06.703382 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-19c938a0-fc59-4eed-90c7-be7991f97ce3 req-d5926f33-7dd2-451f-bd3f-469130d16acb service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:06.703852 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-19c938a0-fc59-4eed-90c7-be7991f97ce3 req-d5926f33-7dd2-451f-bd3f-469130d16acb service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:06.704281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-19c938a0-fc59-4eed-90c7-be7991f97ce3 req-d5926f33-7dd2-451f-bd3f-469130d16acb service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:06.715049 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-19c938a0-fc59-4eed-90c7-be7991f97ce3 req-d5926f33-7dd2-451f-bd3f-469130d16acb service nova] Creating event network-changed:3a2fb6f5-4c77-4613-a8e9-31df96539e3d for instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 on hv-cinder-85200 Sep 11 00:06:06.722904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-19c938a0-fc59-4eed-90c7-be7991f97ce3 req-d5926f33-7dd2-451f-bd3f-469130d16acb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033627 Sep 11 00:06:06.723814 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 300/607] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:06:08.959025 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1793194335", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdc07122-054b-4011-b388-fcaff21bba63"}], "security_groups": [{"name": "tempest-securitygroup--431145988"}], "key_name": "tempest-keypair-365299840", "user_data": "}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:09.060435 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] validate_networks() for [('cdc07122-054b-4011-b388-fcaff21bba63', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:06:09.423150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:06:09.423572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:06:09.424042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:06:09.425317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:06:09.425786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:06:09.436740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:09.437224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:09.437660 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:09.438686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:09.439189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:09.439621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:09.457968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Getting quotas for project 65f0209a8e48496c8d88c885f8364cbd. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:06:09.462200 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Getting quotas for user 9950f578162449c0845c3aa4aab692d4 and project 65f0209a8e48496c8d88c885f8364cbd. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:06:09.473724 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:06:09.479226 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:06:09.623013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c6f5a16f-d087-4a32-90c3-6e00fd4e9191 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.706777 Sep 11 00:06:09.623013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 308/608] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:06:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:06:09.636355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8f025976-ceed-4005-b0ba-903edb37c120 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:09.637189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8f025976-ceed-4005-b0ba-903edb37c120 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:09.639350 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:09.703536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8f025976-ceed-4005-b0ba-903edb37c120 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:09.707427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8f025976-ceed-4005-b0ba-903edb37c120 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1237 microversion: 2.1 time: 0.077274 Sep 11 00:06:09.708005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 301/609] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:09 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:10.730962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:10.731571 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:10.742356 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:10.742356 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:10.742356 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:10.742356 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:10.742932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:10.742932 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:10.816776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:10.824817 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7d9c3ef0-3d90-4cdc-8ded-963271b2e1ab tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1241 microversion: 2.1 time: 0.097561 Sep 11 00:06:10.825388 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 309/610] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:10 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:11.849504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:11.850124 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:11.859654 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:11.860145 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:11.860588 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:11.864641 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:11.864641 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:11.864641 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:11.929591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:11.937618 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-939664bb-9b75-4b56-8df3-e6aa46409e1b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1297 microversion: 2.1 time: 0.093379 Sep 11 00:06:11.938557 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 302/611] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:11 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:12.962250 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:12.967342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:12.970830 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:12.971317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:12.971741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:12.972777 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:12.973215 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:12.973634 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:13.201420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:13.209165 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7cd49cb3-7fa6-46f9-9729-0c16fed6b99f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1362 microversion: 2.1 time: 0.251130 Sep 11 00:06:13.209762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 310/612] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:12 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:13.772525 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-02f8742f-8d9a-465e-9485-49ab52863974 req-44400bec-d81e-4009-8ede-113675edab51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a07dfc-a3f1-4042-9748-7a0a82da7a81", "tag": "81e5dc9c-6d72-46e8-b3a7-c64798c7d90f"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:13.784119 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-02f8742f-8d9a-465e-9485-49ab52863974 req-44400bec-d81e-4009-8ede-113675edab51 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:13.785527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-02f8742f-8d9a-465e-9485-49ab52863974 req-44400bec-d81e-4009-8ede-113675edab51 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:13.786172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-02f8742f-8d9a-465e-9485-49ab52863974 req-44400bec-d81e-4009-8ede-113675edab51 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:13.798129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-02f8742f-8d9a-465e-9485-49ab52863974 req-44400bec-d81e-4009-8ede-113675edab51 service nova] Creating event network-changed:81e5dc9c-6d72-46e8-b3a7-c64798c7d90f for instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 on hv-cinder-85200 Sep 11 00:06:13.803801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-02f8742f-8d9a-465e-9485-49ab52863974 req-44400bec-d81e-4009-8ede-113675edab51 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035164 Sep 11 00:06:13.805238 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 303/613] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:14.231935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:14.232650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:14.239924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:14.240410 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:14.240848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:14.241537 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:14.241990 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:14.242412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:14.453999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:14.465102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5cfc4738-a5a5-48e1-94b9-3ee81cec213d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1362 microversion: 2.1 time: 0.235405 Sep 11 00:06:14.465102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 311/614] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:14 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:15.489133 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:15.489936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:15.496181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:15.496662 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:15.497097 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:15.497781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:15.498229 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:15.498647 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:15.639055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:15.647667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-acec04d5-3dba-4158-92b2-6ec9c3835555 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1362 microversion: 2.1 time: 0.164040 Sep 11 00:06:15.648240 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 304/615] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:15 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:16.670342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:16.671931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:16.680341 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:16.682307 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:16.683144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:16.683791 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:16.684877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:16.685503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:16.686074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:16.823872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:16.831543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ca7617ea-d09f-47d3-9a78-cc1fc1ab46fb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1362 microversion: 2.1 time: 0.165298 Sep 11 00:06:16.832111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 312/616] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:16 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:17.854413 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:17.855286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:17.868685 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:17.869236 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:17.869671 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:17.870404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:17.871594 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:17.871594 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:18.035465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:18.049083 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-db3d071c-063d-483d-ab2e-fc443de3434e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1362 microversion: 2.1 time: 0.198622 Sep 11 00:06:18.066394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 305/617] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:17 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:18.803653 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-6f58eba3-4927-4858-b5d0-77a961727bdc req-ba017779-78a3-484d-8640-2444293ecf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a07dfc-a3f1-4042-9748-7a0a82da7a81", "name": "network-vif-plugged", "status": "completed", "tag": "81e5dc9c-6d72-46e8-b3a7-c64798c7d90f"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:18.816941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6f58eba3-4927-4858-b5d0-77a961727bdc req-ba017779-78a3-484d-8640-2444293ecf96 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:18.817778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6f58eba3-4927-4858-b5d0-77a961727bdc req-ba017779-78a3-484d-8640-2444293ecf96 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:18.818439 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6f58eba3-4927-4858-b5d0-77a961727bdc req-ba017779-78a3-484d-8640-2444293ecf96 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:18.833799 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-6f58eba3-4927-4858-b5d0-77a961727bdc req-ba017779-78a3-484d-8640-2444293ecf96 service nova] Creating event network-vif-plugged:81e5dc9c-6d72-46e8-b3a7-c64798c7d90f for instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 on hv-cinder-85200 Sep 11 00:06:18.841900 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-6f58eba3-4927-4858-b5d0-77a961727bdc req-ba017779-78a3-484d-8640-2444293ecf96 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040279 Sep 11 00:06:18.841900 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 313/618] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:19.074161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:19.074909 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:19.081899 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:19.082461 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:19.082989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:19.083870 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:19.084548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:19.084973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:19.467720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:19.476280 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f40b3e99-009d-4829-832f-751647ec8c20 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1362 microversion: 2.1 time: 0.406316 Sep 11 00:06:19.477624 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 306/619] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:19 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:20.502261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:20.502945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:20.508590 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:20.509483 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=10 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:20.514165 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:20.514888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:20.515325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:20.516288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:20.517353 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:20.517816 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:20.735264 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:20.744926 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d357af30-45d5-4736-8795-08c98b09bccb tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1362 microversion: 2.1 time: 0.246875 Sep 11 00:06:20.762211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 314/620] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:20 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:21.769436 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:21.770064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:21.772079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:21.779925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:21.779925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:21.779925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:21.779925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:21.780320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:21.780634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:21.915507 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:21.923138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d061cb75-2023-463e-b8d4-f340477f870c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1548 microversion: 2.1 time: 0.157538 Sep 11 00:06:21.923785 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 307/621] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:21 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:21.946127 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:21.946708 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:21.954271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:21.954781 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:21.955210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:21.956068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:21.957174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:21.957594 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:22.039944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1ecc4cec-389e-4102-b77b-0411505e98f2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095154 Sep 11 00:06:22.039944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 315/622] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Sep 11 00:06:21 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:23.107250 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-4efb1495-9b84-4d6a-a9ba-2d5094a9398a req-b8437cdf-06a7-4781-9d25-776bdc23943b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a07dfc-a3f1-4042-9748-7a0a82da7a81", "tag": "81e5dc9c-6d72-46e8-b3a7-c64798c7d90f"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:23.123344 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-4efb1495-9b84-4d6a-a9ba-2d5094a9398a req-b8437cdf-06a7-4781-9d25-776bdc23943b service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:23.124140 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-4efb1495-9b84-4d6a-a9ba-2d5094a9398a req-b8437cdf-06a7-4781-9d25-776bdc23943b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:23.124737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-4efb1495-9b84-4d6a-a9ba-2d5094a9398a req-b8437cdf-06a7-4781-9d25-776bdc23943b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:23.157379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-4efb1495-9b84-4d6a-a9ba-2d5094a9398a req-b8437cdf-06a7-4781-9d25-776bdc23943b service nova] Creating event network-changed:81e5dc9c-6d72-46e8-b3a7-c64798c7d90f for instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 on hv-cinder-85200 Sep 11 00:06:23.165296 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-4efb1495-9b84-4d6a-a9ba-2d5094a9398a req-b8437cdf-06a7-4781-9d25-776bdc23943b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063121 Sep 11 00:06:23.167849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 308/623] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:23.310499 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:23.311262 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:23.319973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:23.320644 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:23.321184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:23.322028 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:23.322870 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:23.323398 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:23.435686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lazy-loading 'services' on Instance uuid c65cfc71-51a9-461d-a845-b46e71080e92 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:06:23.720646 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2e77b734-480b-43a5-ab60-f9dbee388787 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments/8f4834f8-6bb2-4505-824f-c80d25249b7b" status: 202 len: 0 microversion: 2.1 time: 0.416969 Sep 11 00:06:23.732364 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:23.735282 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 316/624] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:06:23 2022] DELETE /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments/8f4834f8-6bb2-4505-824f-c80d25249b7b => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:06:23.735507 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:23.742410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:23.743179 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:23.743785 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:23.744841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:23.745441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:23.746014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:23.783693 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8984d82a-de23-431c-a2a3-b2eafcb146fe tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055455 Sep 11 00:06:23.789743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 309/625] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:06:23 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:24.797102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:24.800091 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:24.807252 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:24.807978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:24.808418 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:24.809162 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:24.809623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:24.810040 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:24.860824 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bf96fd24-902d-439c-be92-8c26af42fdc1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068066 Sep 11 00:06:24.869965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 317/626] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:06:24 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:25.877488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:25.880089 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:25.892253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:25.892982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:25.893590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:25.895137 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:25.895600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:25.896020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:25.931774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-60218ce2-a340-4242-bfaf-9b4925ade7d5 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058191 Sep 11 00:06:25.932355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 310/627] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:06:25 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:06:26.039725 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:26.042316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:26.048776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:26.049272 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:26.049741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:26.050739 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:26.051193 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:26.051614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:26.077939 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:26.086435 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:06:26.454330 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fc6bd1fd-be6e-4390-bdcc-d6d5ada48e4d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 204 len: 0 microversion: 2.1 time: 0.418323 Sep 11 00:06:26.455665 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 318/628] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:06:26 2022] DELETE /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:06:26.466047 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:26.466790 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:26.478281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:26.478901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:26.479847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:26.480600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:26.481134 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:26.481628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:26.505720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:26.696564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:26.705151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fdb99e37-0399-4f03-8d8c-f567d41e781b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1688 microversion: 2.1 time: 0.243325 Sep 11 00:06:26.719141 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 311/629] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:26 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1688 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:27.747239 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:27.748651 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:27.758355 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:27.759195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:27.759860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:27.761293 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:27.762472 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:27.763174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:27.965243 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:27.976077 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ca9ce0f1-c7bf-4527-932f-1f1fabcb64ca tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1688 microversion: 2.1 time: 0.233513 Sep 11 00:06:27.976658 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 319/630] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:27 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:28.998740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:28.999326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:29.006647 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:29.007471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:29.007917 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:29.008765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:29.009227 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:29.009658 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:29.157847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:29.165827 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b261e7a1-082e-4f60-a1c7-96b6f4c14ec1 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1688 microversion: 2.1 time: 0.171164 Sep 11 00:06:29.166460 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 312/631] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:28 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:30.195062 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:30.196730 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:30.204487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:30.205339 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:30.205991 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:30.207860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:30.208729 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:30.209450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:30.542165 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:30.549876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-628ab5b0-acba-4a08-8d28-54d6b5445e4a tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1688 microversion: 2.1 time: 0.359958 Sep 11 00:06:30.551154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 320/632] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:30 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1688 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:31.575545 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:31.576384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:31.592503 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:31.593639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:31.600182 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:31.601822 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:31.602871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:31.603319 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:31.722961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-c992fe1c-d09d-45e2-9f76-e1795f6b01c8 req-7883ffb9-5d03-40e6-9963-755c6d37e37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65cfc71-51a9-461d-a845-b46e71080e92", "name": "network-vif-deleted", "tag": "d1ad97b5-d674-4dfa-b8e0-dd3bb492e819"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:31.734044 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-c992fe1c-d09d-45e2-9f76-e1795f6b01c8 req-7883ffb9-5d03-40e6-9963-755c6d37e37a service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:31.734934 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-c992fe1c-d09d-45e2-9f76-e1795f6b01c8 req-7883ffb9-5d03-40e6-9963-755c6d37e37a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:31.741216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-c992fe1c-d09d-45e2-9f76-e1795f6b01c8 req-7883ffb9-5d03-40e6-9963-755c6d37e37a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:31.741445 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:31.755666 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3e71a0e0-89b8-4c80-ad0f-369847f8c232 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1621 microversion: 2.1 time: 0.185112 Sep 11 00:06:31.756800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 321/633] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:31 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1621 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:31.757967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-c992fe1c-d09d-45e2-9f76-e1795f6b01c8 req-7883ffb9-5d03-40e6-9963-755c6d37e37a service nova] Creating event network-vif-deleted:d1ad97b5-d674-4dfa-b8e0-dd3bb492e819 for instance c65cfc71-51a9-461d-a845-b46e71080e92 on hv-cinder-85200 Sep 11 00:06:31.776590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-c992fe1c-d09d-45e2-9f76-e1795f6b01c8 req-7883ffb9-5d03-40e6-9963-755c6d37e37a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332451 Sep 11 00:06:31.783280 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 313/634] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:32.781642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:32.782902 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:32.791593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:32.792399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:32.793236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:32.794058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:32.794766 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:32.795365 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:32.870761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:32.874334 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:32.874927 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:32.875624 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lazy-loading 'fault' on Instance uuid c65cfc71-51a9-461d-a845-b46e71080e92 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:06:32.949483 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:32.957490 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7137311d-05d6-4a82-93cd-a8624c8c7de6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 200 len: 1335 microversion: 2.1 time: 0.179936 Sep 11 00:06:32.958069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 322/635] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:32 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 1335 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:34.136848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:34.138219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: c65cfc71-51a9-461d-a845-b46e71080e92] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:34.144781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:34.145262 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:34.145700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:34.146513 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:34.146875 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:34.147346 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:34.161767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] HTTP exception thrown: Instance c65cfc71-51a9-461d-a845-b46e71080e92 could not be found. Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Request method failure captured: Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 HTTP/1.1 Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVFGZAiyc7PEdHjnPTpZKE5_yItwy5vPJHcwOPgr5_CjblTSvJNtfk4L2GFcbhaf7T50zcH-bmVBQ7tER7-WwV0lDH4ju7hO0sOUPUYkSld0V4_GqymUN6XoGtdnxK-4hbpYd6s8bSl8h0NMkvxI2kuILXo4ydne9C-3jhQm-3MLV0 Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:06:34.163455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0b35b1c14ba4a2e9b23a223628b449c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}] Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: b8ceeb13c4c24ceb9ff1f27b4e45f62c Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance c65cfc71-51a9-461d-a845-b46e71080e92 could not be found. Sep 11 00:06:34.165127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'c65cfc71-51a9-461d-a845-b46e71080e92'} Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65cfc71-51a9-461d-a845-b46e71080e92 could not be found. Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:06:34.169619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65cfc71-51a9-461d-a845-b46e71080e92 could not be found. Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65cfc71-51a9-461d-a845-b46e71080e92 could not be found. Sep 11 00:06:34.171222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:34.172538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Returning 404 to user: Instance c65cfc71-51a9-461d-a845-b46e71080e92 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:06:34.172538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7e16e8c0-bf5c-4798-9c5b-b77841fea98d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92" status: 404 len: 111 microversion: 2.1 time: 0.032772 Sep 11 00:06:34.172538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 314/636] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:34 2022] GET /compute/v2.1/servers/c65cfc71-51a9-461d-a845-b46e71080e92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:06:34.176639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-97de8ee4-cde2-46d9-a556-32dd88c20f58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '.version_select at 0x7f5ab68701f0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:34.252633 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-97de8ee4-cde2-46d9-a556-32dd88c20f58 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-862996622" status: 202 len: 0 microversion: 2.1 time: 0.081007 Sep 11 00:06:34.254253 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 323/637] 10.222.0.17 () {58 vars in 1218 bytes} [Sun Sep 11 00:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-862996622 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:06:37.770394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:37.773132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:37.779642 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:37.780383 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:37.781140 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:37.782045 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:37.782491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:37.783060 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:37.815361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Going to try to terminate instance {{(pid=121068) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:06:38.114418 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1f0f5017-dc8c-4b16-9f3c-5c110326bf93 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "DELETE /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 204 len: 0 microversion: 2.1 time: 0.347708 Sep 11 00:06:38.115040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 315/638] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:06:37 2022] DELETE /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:06:38.126054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:38.126698 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:38.136334 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:38.139544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:38.139544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:38.139544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:38.139544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:38.140210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:38.281508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:38.291743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b7ddd833-0862-4ee0-9b8b-d5ee3a84f24f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1507 microversion: 2.1 time: 0.170029 Sep 11 00:06:38.292879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 324/639] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:38 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:39.315962 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:39.316938 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:39.323700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:39.324184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:39.324622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:39.325313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:39.325763 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:39.326184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:39.463469 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:39.471124 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-67b26d60-ec2b-44ab-972d-918b33b3ccbf tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1507 microversion: 2.1 time: 0.159360 Sep 11 00:06:39.471692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 316/640] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:39 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:40.495340 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:40.495982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:40.502537 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:40.503556 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:40.503998 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:40.504677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:40.505188 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:40.505607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:40.637365 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:40.645905 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-26a0907a-5c82-4cd6-bb4a-1f90bb31507d tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1507 microversion: 2.1 time: 0.154482 Sep 11 00:06:40.646470 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 325/641] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:40 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:40.814890 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-136eab14-29c3-45d5-97cf-2c0c40ffd50d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Action: 'create', calling method: .version_select at 0x7f5ab6831820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1487548508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7ohwoAcYNJM0ZxIno//Cep9FKmRA1pq0SLL7ckWEHVxWqPNdTIAfZq43gNQ6mTNKGDtSiBGC80q0A7XuF2h8OXs5etnbFaPneGGLQSdUNVsAXJvDjASKuQn8dd7GLQpw=="}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:40.837764 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-136eab14-29c3-45d5-97cf-2c0c40ffd50d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Getting quotas for project 82b6b05c598d44ee8b8748b6bab1f9e5. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:06:40.841508 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-136eab14-29c3-45d5-97cf-2c0c40ffd50d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Getting quotas for user fd106d45a1ce4aad9c85c35d4f53af92 and project 82b6b05c598d44ee8b8748b6bab1f9e5. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:06:40.921968 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-136eab14-29c3-45d5-97cf-2c0c40ffd50d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.110930 Sep 11 00:06:40.924451 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 317/642] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:06:40 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:06:40.980609 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1705474510", "imageRef": "3c3aa079-36cd-4243-861e-9d37a3d1d42c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1487548508", "networks": [{"uuid": "bb02977f-bb5c-4ab2-bcf1-6066e31249c6"}]}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:41.037235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] validate_networks() for [('bb02977f-bb5c-4ab2-bcf1-6066e31249c6', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:06:41.617353 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-0483cd42-ed5f-409e-9d64-5e916e9f12c4 req-3e3821ab-6000-4c76-924a-ce60cd871885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19befee5-042c-4c4f-b62a-97895fa670e6", "name": "network-vif-deleted", "tag": "58e33c04-4056-48ff-a50f-3c168b0b931e"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:41.627234 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-0483cd42-ed5f-409e-9d64-5e916e9f12c4 req-3e3821ab-6000-4c76-924a-ce60cd871885 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:41.629904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-0483cd42-ed5f-409e-9d64-5e916e9f12c4 req-3e3821ab-6000-4c76-924a-ce60cd871885 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:41.629904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-0483cd42-ed5f-409e-9d64-5e916e9f12c4 req-3e3821ab-6000-4c76-924a-ce60cd871885 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:41.640370 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-0483cd42-ed5f-409e-9d64-5e916e9f12c4 req-3e3821ab-6000-4c76-924a-ce60cd871885 service nova] Creating event network-vif-deleted:58e33c04-4056-48ff-a50f-3c168b0b931e for instance 19befee5-042c-4c4f-b62a-97895fa670e6 on hv-cinder-85200 Sep 11 00:06:41.646172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-0483cd42-ed5f-409e-9d64-5e916e9f12c4 req-3e3821ab-6000-4c76-924a-ce60cd871885 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Sep 11 00:06:41.647217 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 318/643] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:06:41.669433 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:41.670317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:41.677580 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:41.678070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:41.679304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:41.681597 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:41.682067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:41.682727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:41.731259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:06:41.731768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:06:41.732201 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:06:41.732605 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:06:41.733013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:06:41.742504 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:41.743020 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:41.743510 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:41.744226 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:41.744673 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:41.745093 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:41.748377 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:41.757638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0389e642-5e48-4119-af4c-6e01b5f38027 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1465 microversion: 2.1 time: 0.092479 Sep 11 00:06:41.758466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 319/644] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:41 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1465 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:41.762400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Getting quotas for project 82b6b05c598d44ee8b8748b6bab1f9e5. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:06:41.766967 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Getting quotas for user fd106d45a1ce4aad9c85c35d4f53af92 and project 82b6b05c598d44ee8b8748b6bab1f9e5. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:06:41.779745 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:06:41.782004 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c3aa079-36cd-4243-861e-9d37a3d1d42c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:06:41.948311 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e4224985-195b-42b4-9d30-ed1b929584aa tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971324 Sep 11 00:06:41.949142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 326/645] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:06:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:06:41.961580 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1237ac01-9a2b-4e03-a34a-555ddd81d179 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:41.962202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1237ac01-9a2b-4e03-a34a-555ddd81d179 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:41.974945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:42.037746 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1237ac01-9a2b-4e03-a34a-555ddd81d179 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:42.044482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1237ac01-9a2b-4e03-a34a-555ddd81d179 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1259 microversion: 2.1 time: 0.087163 Sep 11 00:06:42.045037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 320/646] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:41 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1259 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:42.782485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:42.783052 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:42.790326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:42.790921 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:42.791371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:42.792054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:42.792497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:42.792912 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:42.833404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:42.833886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:42.834317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:42.834789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lazy-loading 'fault' on Instance uuid 19befee5-042c-4c4f-b62a-97895fa670e6 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:06:42.889317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:42.898278 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f9537b00-6220-4435-8100-299970325855 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 200 len: 1311 microversion: 2.1 time: 0.119794 Sep 11 00:06:42.898876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 327/647] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:42 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:42.951077 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:42.951572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:42.958983 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:42.959462 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:42.959892 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:42.960577 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:42.961019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:42.961439 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:42.984702 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-378309de-6a8a-495c-a7f6-17816f3becb5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/ips" status: 200 len: 150 microversion: 2.20 time: 0.155034 Sep 11 00:06:42.985336 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 321/648] 10.222.0.17 () {60 vars in 1289 bytes} [Sun Sep 11 00:06:42 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/ips => generated 150 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 00:06:43.071298 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4affb7e4-d129-41b9-a1f1-f696b170b06d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:43.072577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4affb7e4-d129-41b9-a1f1-f696b170b06d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:43.127291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4affb7e4-d129-41b9-a1f1-f696b170b06d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:43.137487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4affb7e4-d129-41b9-a1f1-f696b170b06d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1259 microversion: 2.1 time: 0.072817 Sep 11 00:06:43.140112 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 328/649] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:43 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:43.922133 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:43.922887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 19befee5-042c-4c4f-b62a-97895fa670e6] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:43.930466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:43.931043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:43.931483 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:43.932181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:43.932643 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:43.933063 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:43.947647 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] HTTP exception thrown: Instance 19befee5-042c-4c4f-b62a-97895fa670e6 could not be found. Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Request method failure captured: Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 HTTP/1.1 Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVFGZAiyc7PEdHjnPTpZKE5_yItwy5vPJHcwOPgr5_CjblTSvJNtfk4L2GFcbhaf7T50zcH-bmVBQ7tER7-WwV0lDH4ju7hO0sOUPUYkSld0V4_GqymUN6XoGtdnxK-4hbpYd6s8bSl8h0NMkvxI2kuILXo4ydne9C-3jhQm-3MLV0 Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:06:43.949737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0b35b1c14ba4a2e9b23a223628b449c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}] Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: b8ceeb13c4c24ceb9ff1f27b4e45f62c Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 19befee5-042c-4c4f-b62a-97895fa670e6 could not be found. Sep 11 00:06:43.951293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '19befee5-042c-4c4f-b62a-97895fa670e6'} Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19befee5-042c-4c4f-b62a-97895fa670e6 could not be found. Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:06:43.952182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19befee5-042c-4c4f-b62a-97895fa670e6 could not be found. Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19befee5-042c-4c4f-b62a-97895fa670e6 could not be found. Sep 11 00:06:43.953411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:43.954527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Returning 404 to user: Instance 19befee5-042c-4c4f-b62a-97895fa670e6 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:06:43.954527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-be19ceeb-a49f-410e-ac12-730674b0b09c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6" status: 404 len: 111 microversion: 2.1 time: 0.033043 Sep 11 00:06:43.954527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 322/650] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:43 2022] GET /compute/v2.1/servers/19befee5-042c-4c4f-b62a-97895fa670e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:06:43.959826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:43.960314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:43.967307 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:43.978295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:43.978295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:43.978295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:43.978295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:43.978681 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:43.994724 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:06:44.162707 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:44.163324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:44.169777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:44.170255 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:44.170714 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:44.171405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:44.171855 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:44.172330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:44.238856 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:44.246467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-17f0c8df-fbe8-4345-84d8-f19a6b5bec99 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1311 microversion: 2.1 time: 0.087945 Sep 11 00:06:44.247063 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 323/651] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:44 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:44.256897 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2f8095ef-0d20-4034-8ea6-8157d8f8648b tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 204 len: 0 microversion: 2.1 time: 0.300756 Sep 11 00:06:44.257472 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 329/652] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:06:43 2022] DELETE /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:06:44.270752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:44.271354 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:44.277089 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:44.277556 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:44.277984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:44.278714 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:44.279123 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:44.279544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:44.406602 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:44.414975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-27f07438-b5d2-45b1-af73-b4c0b779da81 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.147893 Sep 11 00:06:44.415609 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 324/653] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:44 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:45.273346 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:45.274037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:45.280352 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:45.280832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:45.281271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:45.281955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:45.282401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:45.282848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:45.348011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:45.355835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1a55c77a-aa4d-43e3-85d4-ccf0133abcf8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1319 microversion: 2.1 time: 0.087652 Sep 11 00:06:45.356426 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 330/654] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:45 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:45.438232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:45.438892 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:45.445967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:45.446436 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:45.446898 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:45.447588 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:45.448035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:45.448705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:45.581437 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:45.585448 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:45.585974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:45.589132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-215edba4-2f2f-4494-95d0-329c97cd22c2 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.154952 Sep 11 00:06:45.589700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 325/655] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:45 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:45.591920 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:45.592403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:45.592836 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:45.593521 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:45.593967 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:45.594395 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:45.617369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lazy-loading 'flavor' on Instance uuid ede54ea4-13f8-4bf2-bba7-8291c078c1c8 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:06:45.892843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:46.073402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-242b2395-65f9-4a22-9d7f-48ffefc0ce79 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/action" status: 202 len: 0 microversion: 2.20 time: 0.491693 Sep 11 00:06:46.073995 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 331/656] 10.222.0.17 () {62 vars in 1319 bytes} [Sun Sep 11 00:06:45 2022] POST /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:06:46.082175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:46.082864 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:46.088845 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:46.092283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:46.092283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:46.092283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:46.092283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:46.092638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:46.219486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:46.228410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:46.229835 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:46.231019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d41f8b30-6919-4556-a181-9e1f4a9f6f8a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.152618 Sep 11 00:06:46.231566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 326/657] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:46 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:46.380384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:46.381082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:46.387324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:46.387807 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:46.388243 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:46.388928 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:46.389377 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:46.389799 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:46.451418 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:46.459698 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-7d897ed7-7b56-4b51-ba8e-0c8ff53bbeb8 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1319 microversion: 2.1 time: 0.083957 Sep 11 00:06:46.460261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 332/658] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:46 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1319 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:46.612303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:46.612990 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:46.619445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:46.619943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:46.620374 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:46.621047 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:46.621490 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:46.621903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:46.747709 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:46.756005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-cf6b1203-7f38-4bf0-8824-f525af1fd40c tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.147335 Sep 11 00:06:46.756597 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 327/659] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:46 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:47.257343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:47.257952 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:47.264037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:47.264516 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:47.264949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:47.265630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:47.266082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:47.266517 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:47.402674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:47.411229 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:47.412673 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:47.414636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fab8392b-286a-4146-82fb-c84d71507cfa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.161973 Sep 11 00:06:47.415685 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 333/660] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:47 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:47.482067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:47.482795 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:47.489701 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:47.490177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:47.490605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:47.491315 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:47.491754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:47.492170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:47.562859 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:47.571559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-50129f01-d6f5-4339-9c02-e5aef2f2e26f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1319 microversion: 2.1 time: 0.093362 Sep 11 00:06:47.572121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 328/661] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:47 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:47.779691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:47.780303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:47.787011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:47.787719 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:47.788341 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:47.789358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:47.789973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:47.790392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:48.340447 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:48.357415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6bcd659d-062c-43f8-be8d-376aebdadc07 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1521 microversion: 2.1 time: 0.581640 Sep 11 00:06:48.358011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 334/662] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:47 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:48.441306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:48.443031 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:48.456520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:48.458014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:48.461914 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:48.463122 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:48.463778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:48.464833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:48.601260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:48.602079 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:48.608739 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:48.609654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:48.610390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:48.611293 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:48.611902 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:48.612471 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:48.681442 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:48.690747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:48.696877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:48.703397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7a556281-4ff9-47fd-a988-bba7b2c297a6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.262196 Sep 11 00:06:48.703397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 329/663] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:48 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:48.734820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:48.748056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-90f2558e-fbc2-4439-b64a-758d2d61ac5e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1317 microversion: 2.1 time: 0.156876 Sep 11 00:06:48.749031 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 335/664] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:48 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:49.027517 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-7ce339e4-8b01-4f3b-b04d-ae79ef4ded46 req-0a07c17b-21a5-4862-b1d7-3252480a4588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6501cde1-0dad-4b77-a8d3-39cc6b8ef289", "name": "network-vif-deleted", "tag": "0ad72262-66bc-4d5d-bbde-9c1e7c90fdec"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:49.046297 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-7ce339e4-8b01-4f3b-b04d-ae79ef4ded46 req-0a07c17b-21a5-4862-b1d7-3252480a4588 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:49.047096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-7ce339e4-8b01-4f3b-b04d-ae79ef4ded46 req-0a07c17b-21a5-4862-b1d7-3252480a4588 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:49.047590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-7ce339e4-8b01-4f3b-b04d-ae79ef4ded46 req-0a07c17b-21a5-4862-b1d7-3252480a4588 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:49.059425 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-7ce339e4-8b01-4f3b-b04d-ae79ef4ded46 req-0a07c17b-21a5-4862-b1d7-3252480a4588 service nova] Creating event network-vif-deleted:0ad72262-66bc-4d5d-bbde-9c1e7c90fdec for instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 on hv-cinder-85200 Sep 11 00:06:49.066049 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-7ce339e4-8b01-4f3b-b04d-ae79ef4ded46 req-0a07c17b-21a5-4862-b1d7-3252480a4588 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044843 Sep 11 00:06:49.068036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 330/665] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:06:49.390056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:49.390873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:49.398497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:49.399303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:49.399990 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:49.401061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:49.401708 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:49.402135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:49.471230 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:49.479717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-03939dc6-27e0-433f-a179-6b3b4b77735f tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1479 microversion: 2.1 time: 0.093784 Sep 11 00:06:49.480297 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 336/666] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:49 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1479 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:49.727073 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:49.727814 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:49.734037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:49.734521 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:49.735148 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:49.735851 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:49.736306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:49.736733 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:49.779802 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:49.781032 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:49.787985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:49.788469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:49.789117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:49.789815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:49.790260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:49.790695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:49.900473 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:49.911524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:49.915153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:49.915153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3a94b643-c484-40e4-a73e-aee36f24bc7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.192376 Sep 11 00:06:49.915153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 331/667] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:49 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:49.960706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:49.969199 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bd901b1e-3dfc-4315-acc8-69398ad5cdf6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.193044 Sep 11 00:06:49.969888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 337/668] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:49 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:50.502867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:50.503480 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:50.509535 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:50.510019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:50.510458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:50.511198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:50.511655 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:50.512184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:50.515032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:50.591910 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:50.600369 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f1e78f65-66a0-4228-b17f-edb43314bf48 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1479 microversion: 2.1 time: 0.101328 Sep 11 00:06:50.600958 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 332/669] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:50 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1479 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:50.940782 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:50.941420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:50.944196 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:50.949263 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:50.949747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:50.950187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:50.950908 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:50.951358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:50.951778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:51.057380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:51.058061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:51.070921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:51.071440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:51.072022 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:51.072774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:51.073474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:51.073907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:51.106845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:51.117210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:51.118647 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:51.119849 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-25b8590c-dbac-4ef8-b4ef-9619dd77532c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.183047 Sep 11 00:06:51.120446 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 338/670] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:50 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:51.231561 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:51.240435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-de8bfe8d-e1f3-471a-aeee-fe35da63df24 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.187950 Sep 11 00:06:51.241006 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 333/671] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:51 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:51.625056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:51.625594 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:51.633144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:51.633636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:51.634076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:51.634808 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:51.635266 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:51.635690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:51.704008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:51.711742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bb7b9b12-14c7-41cc-94f0-862ef507a012 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1479 microversion: 2.1 time: 0.091480 Sep 11 00:06:51.712497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 339/672] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:51 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1479 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:52.147127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:52.147823 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:52.149659 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=6 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:52.155088 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:52.155567 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:52.156072 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:52.156768 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:52.157213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:52.157628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:52.261369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:52.266915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:52.267789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:52.279299 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:52.279866 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:52.281483 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:52.282198 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:52.282683 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:52.283127 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:52.314302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:52.327407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:52.329756 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:52.331380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e71bd767-e967-49f9-8fed-3de0b434a677 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.188500 Sep 11 00:06:52.341561 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 334/673] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:52 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:52.471623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:52.479632 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ca0b8abd-f535-4fe7-983f-9dc32e591b0a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.219130 Sep 11 00:06:52.480214 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 340/674] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:52 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:52.735654 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:52.736888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:52.744480 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:52.745285 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:52.745943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:52.747099 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:52.747777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:52.748268 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:52.820783 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:52.829035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2238a7d4-7643-4140-bfcb-c728ee558702 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1479 microversion: 2.1 time: 0.097466 Sep 11 00:06:52.829609 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 335/675] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:52 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1479 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:53.357564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:53.358354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:53.361055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=8 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:53.367232 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:53.367720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:53.368150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:53.368881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:53.369329 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:53.369746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:53.505376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:53.506586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:53.514198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:53.515081 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:53.515536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:53.516817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:53.520713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:53.520713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:53.520943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:53.528264 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:53.529700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:53.531051 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6f5b4c0c-d0c5-47c7-8f8d-23b4d3f1ffc5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.177908 Sep 11 00:06:53.540790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 341/676] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:53 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:53.669389 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:53.679063 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-53926439-f892-4b8b-9843-23e3c098832e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.178472 Sep 11 00:06:53.679649 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 336/677] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:53 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:53.853835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:53.854522 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:53.860678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:53.861155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:53.861606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:53.862293 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:53.862796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:53.863212 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:53.930472 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:53.939716 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f685efa6-76f9-47ca-9abf-df1816e676f6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1479 microversion: 2.1 time: 0.089596 Sep 11 00:06:53.940650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 342/678] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:53 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1479 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:54.566907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:54.567612 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:54.574432 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:54.574932 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:54.575404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:54.576086 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:54.576530 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:54.576946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:54.708803 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:54.710677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:54.719548 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:54.720352 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:54.721012 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:54.721308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:54.722255 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:54.723714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:54.724576 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:54.736320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:54.737934 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:54.739633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bb65f591-1a82-452a-932e-0fc9a860bec9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.176878 Sep 11 00:06:54.740191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 337/679] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:54 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:54.879065 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:54.886994 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-487dfae3-f90b-4549-a9a1-6ff36b5b5886 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.185525 Sep 11 00:06:54.890176 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 343/680] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:54 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:54.963885 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:54.964551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:54.971112 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:54.971691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:54.972207 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:54.973759 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:54.974378 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:54.974974 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:55.052151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:55.060078 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c0e6a061-89ac-4a3f-825b-2dc0f894b7e0 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1479 microversion: 2.1 time: 0.100119 Sep 11 00:06:55.060640 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 338/681] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:54 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1479 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:55.767616 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:55.768425 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:55.775703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:55.776189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:55.776626 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:55.777335 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:55.777838 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:55.778296 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:55.913417 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:55.914080 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:55.920995 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:55.921579 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:55.922093 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:55.922920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:55.923551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:55.923857 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:55.926588 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:55.937830 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:55.939289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:55.940452 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d3d2ead0-480d-480c-95d8-0044ce06cd3d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.176960 Sep 11 00:06:55.941195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 344/682] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:55 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:56.072468 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:56.080883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c5accfb9-184c-49a2-be04-857d5b1ad0b9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.171413 Sep 11 00:06:56.081861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 339/683] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:55 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:56.085637 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:56.086246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:56.092256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:56.092740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:56.093171 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:56.093860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:56.094302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:56.094732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:56.156924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:56.164791 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ecdaf4b5-149b-4bee-aba3-df98bfa96ec6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1479 microversion: 2.1 time: 0.083759 Sep 11 00:06:56.165349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 345/684] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:56 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1479 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:56.966810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:56.967423 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:56.973486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:56.980367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:56.980367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:56.980367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:56.980367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:56.980838 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:57.105699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:57.106473 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:57.112875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:57.113222 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:57.113906 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:57.114763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:57.115146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:57.115559 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:57.116327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:57.125836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:57.129298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:57.129298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9382ec5e-0444-417f-ae1e-bbbe3a095216 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.165886 Sep 11 00:06:57.129756 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 340/685] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:56 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:57.190721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:57.191332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:57.200146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:57.200841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:57.201275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:57.202082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:57.202651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:57.203218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:57.243960 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:57.244524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:57.245274 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:57.245797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lazy-loading 'fault' on Instance uuid 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:06:57.293292 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:57.294309 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ceeb13c4c24ceb9ff1f27b4e45f62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b35b1c14ba4a2e9b23a223628b449c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:57.301402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f81bed21-0e0a-40d8-a895-83ff2047fc14 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.199558 Sep 11 00:06:57.303409 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 346/686] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:57 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:57.304279 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bf55196a-8687-4056-a231-e774c4be81c6 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 200 len: 1311 microversion: 2.1 time: 0.117308 Sep 11 00:06:57.305014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 341/687] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:57 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:06:57.726576 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-69b7cb78-4d31-4656-bf9c-46a17a8fc80d req-c4287559-f837-4b03-9879-755a938adc1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7275256b-8e7b-4327-924b-fdde977cb722", "tag": "e95bb83f-e43c-448b-9195-7dc5592a9c51"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:06:57.736767 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-69b7cb78-4d31-4656-bf9c-46a17a8fc80d req-c4287559-f837-4b03-9879-755a938adc1a service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:57.737295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-69b7cb78-4d31-4656-bf9c-46a17a8fc80d req-c4287559-f837-4b03-9879-755a938adc1a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:57.737855 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-69b7cb78-4d31-4656-bf9c-46a17a8fc80d req-c4287559-f837-4b03-9879-755a938adc1a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:57.751059 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-69b7cb78-4d31-4656-bf9c-46a17a8fc80d req-c4287559-f837-4b03-9879-755a938adc1a service nova] Creating event network-changed:e95bb83f-e43c-448b-9195-7dc5592a9c51 for instance 7275256b-8e7b-4327-924b-fdde977cb722 on hv-cinder-85200 Sep 11 00:06:57.756202 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-69b7cb78-4d31-4656-bf9c-46a17a8fc80d req-c4287559-f837-4b03-9879-755a938adc1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034027 Sep 11 00:06:57.756752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 347/688] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:06:58.157220 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:58.157848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:58.165019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:58.165491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:58.165918 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:58.166600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:58.167067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:58.167488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:58.299476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:58.309656 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:58.311203 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:58.312407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-99204a0a-3fb9-468e-8ab1-52af1fc7d25d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.159216 Sep 11 00:06:58.312969 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 342/689] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:58 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:58.326530 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:58.327524 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:58.331429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:58.332222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] [instance: 6501cde1-0dad-4b77-a8d3-39cc6b8ef289] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:58.334688 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:58.335188 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:58.335656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:58.336332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:58.336774 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:58.337220 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:58.339061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:58.347232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:58.347232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:58.347232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:58.347232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:58.347912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:58.355954 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] HTTP exception thrown: Instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 could not be found. Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Request method failure captured: Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 HTTP/1.1 Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVFGZAiyc7PEdHjnPTpZKE5_yItwy5vPJHcwOPgr5_CjblTSvJNtfk4L2GFcbhaf7T50zcH-bmVBQ7tER7-WwV0lDH4ju7hO0sOUPUYkSld0V4_GqymUN6XoGtdnxK-4hbpYd6s8bSl8h0NMkvxI2kuILXo4ydne9C-3jhQm-3MLV0 Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:06:58.357831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0b35b1c14ba4a2e9b23a223628b449c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0b35b1c14ba4a2e9b23a223628b449c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0b35b1c14ba4a2e9b23a223628b449c"}]}] Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: b0b35b1c14ba4a2e9b23a223628b449c Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641160554 Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: b8ceeb13c4c24ceb9ff1f27b4e45f62c Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641160554-project Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 could not be found. Sep 11 00:06:58.359551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '6501cde1-0dad-4b77-a8d3-39cc6b8ef289'} Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 could not be found. Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:06:58.360464 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 could not be found. Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 could not be found. Sep 11 00:06:58.361942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:06:58.363301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] Returning 404 to user: Instance 6501cde1-0dad-4b77-a8d3-39cc6b8ef289 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:06:58.363301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-72296983-e00e-4965-b60f-6621582f9820 tempest-ServerRescueNegativeTestJSON-1641160554 tempest-ServerRescueNegativeTestJSON-1641160554-project] 10.222.0.17 "GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289" status: 404 len: 111 microversion: 2.1 time: 0.031537 Sep 11 00:06:58.363301 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 343/690] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:58 2022] GET /compute/v2.1/servers/6501cde1-0dad-4b77-a8d3-39cc6b8ef289 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:06:58.582302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:58.591311 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d4fc22db-2f16-42a2-a0db-be062e3634da tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.269555 Sep 11 00:06:58.607426 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 348/691] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:58 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:06:59.340728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:59.341337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:59.347874 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:59.348352 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:59.349116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:59.349865 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:59.350258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:59.350692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:59.572883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:59.581394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:59.583145 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:59.585298 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9d9f847f-164c-4fe8-99fa-6d570ac89f3a tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.248408 Sep 11 00:06:59.585849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 344/692] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:06:59 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:06:59.615326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:06:59.615965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:06:59.623043 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:59.623530 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:59.624029 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:59.624726 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:06:59.625174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:06:59.625596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:06:59.629832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:06:59.771781 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:06:59.780678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-50331fac-7280-457a-b4e3-3cd12874c2f6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.169835 Sep 11 00:06:59.781264 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 349/693] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:06:59 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:00.611216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:00.611816 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:00.618811 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:00.619285 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:00.619712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:00.620409 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:00.621037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:00.621463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:00.804203 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:00.805479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:00.815809 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:00.819585 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:00.820332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:00.821204 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:00.822129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:00.822797 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:00.825493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:00.828357 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:00.829793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:00.831497 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6cffd126-9a38-4112-8170-94bb1fa01490 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.224186 Sep 11 00:07:00.832417 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 345/694] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:00 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:01.081616 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:01.091614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-718c3e0d-c54d-4f0b-948f-2b35b9738f35 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.291257 Sep 11 00:07:01.092692 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 350/695] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:00 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:07:01.857124 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:01.857728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:01.864848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:01.865335 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:01.865965 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:01.866681 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:01.867822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:01.868247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:02.115291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:02.116028 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:02.118249 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:02.124168 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:02.124724 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:02.125368 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:02.126510 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:02.127184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:02.127827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:02.128908 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:02.130487 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:02.132360 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0e1ab60c-0a9a-4e31-9c9d-5db287288f58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.278838 Sep 11 00:07:02.133322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 346/696] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:01 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:02.338654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:02.348141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-aed7b4c5-545b-48e1-b89f-c1165c25fa86 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.236465 Sep 11 00:07:02.362801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 351/697] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:02 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:03.158634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:03.159269 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:03.166573 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:03.167090 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:03.167526 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:03.168216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:03.168724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:03.169150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:03.264256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-7d866607-c853-4f52-b71f-fd832c80b4fa req-53562947-c474-421c-9220-6ed1644f7b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7275256b-8e7b-4327-924b-fdde977cb722", "name": "network-vif-plugged", "status": "completed", "tag": "e95bb83f-e43c-448b-9195-7dc5592a9c51"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:03.274627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7d866607-c853-4f52-b71f-fd832c80b4fa req-53562947-c474-421c-9220-6ed1644f7b4b service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:03.276011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7d866607-c853-4f52-b71f-fd832c80b4fa req-53562947-c474-421c-9220-6ed1644f7b4b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:03.276011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7d866607-c853-4f52-b71f-fd832c80b4fa req-53562947-c474-421c-9220-6ed1644f7b4b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:03.287925 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-7d866607-c853-4f52-b71f-fd832c80b4fa req-53562947-c474-421c-9220-6ed1644f7b4b service nova] Creating event network-vif-plugged:e95bb83f-e43c-448b-9195-7dc5592a9c51 for instance 7275256b-8e7b-4327-924b-fdde977cb722 on hv-cinder-85200 Sep 11 00:07:03.293099 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-7d866607-c853-4f52-b71f-fd832c80b4fa req-53562947-c474-421c-9220-6ed1644f7b4b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119527 Sep 11 00:07:03.294170 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 352/698] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:03.320110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:03.328728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:03.330175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:03.331369 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f0ac535a-41a8-4b58-8723-354638ab9585 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.176704 Sep 11 00:07:03.331937 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 347/699] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:03 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:03.374476 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:03.375511 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:03.383109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:03.383605 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:03.384040 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:03.384743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:03.385194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:03.385813 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:03.580572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:03.588614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0504ccba-d725-48e6-8220-72d9054861ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.219331 Sep 11 00:07:03.589286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 353/700] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:03 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:04.356430 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:04.357040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:04.363520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:04.364002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:04.365185 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:04.366060 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:04.366514 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:04.366977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:04.502868 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:04.512020 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:04.513675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:04.514868 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5f9c5e8d-755f-4dc0-b631-f4f50e8d89bf tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1742 microversion: 2.20 time: 0.162304 Sep 11 00:07:04.515419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 348/701] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:04 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:04.611290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:04.611891 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:04.618896 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:04.619373 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:04.619799 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:04.620477 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:04.620916 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:04.621326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:04.754825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:04.762707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a76a9fea-996e-40b6-8d3a-c196d90ba26b tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1359 microversion: 2.1 time: 0.155094 Sep 11 00:07:04.763876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 354/702] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:04 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:04.837923 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-03187dce-64f2-4ae0-aca4-6baec6bd4e81 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Action: 'create', calling method: .version_select at 0x7f5ab67524c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1054077057", "metadata": {"Type": "work"}}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-03187dce-64f2-4ae0-aca4-6baec6bd4e81 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Request method failure captured: Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 122 Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSaodNki82aRSmaSHTnJ88oRRMCGIVw3F_UAje0N8oP0FCWZripRt6V7LBGRi4ASZ7cn98Y0hoQTR86fe4t1kMCxhAFlNhkSD9d_uPJsaJ7MmD5qLgZ-JOJBRGKP_Z69_ud8gUk-xDPRIAKBUVBZcDEAhTTNKW5dF3YZ8IXxcf0l1rU Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:07:04.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e41ad56c0424e968f513b1175c599d9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}] Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 97b33ea3125442d187b9d8d4b169aab5 Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1054077057", "metadata": {"Type": "work"}}} Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: Sep 11 00:07:04.853669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1054077057', 'metadata': {'Type': 'work'}}}} Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise error Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi '#$%' Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:07:04.854650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 00:07:04.856247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 00:07:04.857614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 00:07:04.857614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.857614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-03187dce-64f2-4ae0-aca4-6baec6bd4e81 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:07:04.857614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-03187dce-64f2-4ae0-aca4-6baec6bd4e81 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.159030 Sep 11 00:07:04.857614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 349/703] 10.222.0.17 () {60 vars in 1156 bytes} [Sun Sep 11 00:07:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:07:04.866765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d55a0dbe-12a7-4b9c-9eb4-5e39382291c4 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Action: 'create', calling method: .version_select at 0x7f5ab67c2160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1044163716", "metadata": {"Type": "work"}}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d55a0dbe-12a7-4b9c-9eb4-5e39382291c4 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Request method failure captured: Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 120 Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSaodNki82aRSmaSHTnJ88oRRMCGIVw3F_UAje0N8oP0FCWZripRt6V7LBGRi4ASZ7cn98Y0hoQTR86fe4t1kMCxhAFlNhkSD9d_uPJsaJ7MmD5qLgZ-JOJBRGKP_Z69_ud8gUk-xDPRIAKBUVBZcDEAhTTNKW5dF3YZ8IXxcf0l1rU Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:07:04.871763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e41ad56c0424e968f513b1175c599d9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}] Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 97b33ea3125442d187b9d8d4b169aab5 Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1044163716", "metadata": {"Type": "work"}}} Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: Sep 11 00:07:04.873223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1044163716', 'metadata': {'Type': 'work'}}}} Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise error Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi '0' Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:07:04.874143 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 00:07:04.876597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 00:07:04.877913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 00:07:04.877913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.877913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d55a0dbe-12a7-4b9c-9eb4-5e39382291c4 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:07:04.877913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d55a0dbe-12a7-4b9c-9eb4-5e39382291c4 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011090 Sep 11 00:07:04.877913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 355/704] 10.222.0.17 () {60 vars in 1156 bytes} [Sun Sep 11 00:07:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:07:04.884476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d1f41dd3-ec17-4192-8d58-3a728e078892 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Action: 'create', calling method: .version_select at 0x7f5ab66fb8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1895338128", "metadata": {"Type": "work"}}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d1f41dd3-ec17-4192-8d58-3a728e078892 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Request method failure captured: Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 119 Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSaodNki82aRSmaSHTnJ88oRRMCGIVw3F_UAje0N8oP0FCWZripRt6V7LBGRi4ASZ7cn98Y0hoQTR86fe4t1kMCxhAFlNhkSD9d_uPJsaJ7MmD5qLgZ-JOJBRGKP_Z69_ud8gUk-xDPRIAKBUVBZcDEAhTTNKW5dF3YZ8IXxcf0l1rU Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:07:04.886807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e41ad56c0424e968f513b1175c599d9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}] Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 97b33ea3125442d187b9d8d4b169aab5 Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1895338128", "metadata": {"Type": "work"}}} Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: Sep 11 00:07:04.888407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1895338128', 'metadata': {'Type': 'work'}}}} Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise error Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi '' Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:07:04.893182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 00:07:04.894722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 00:07:04.896743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 00:07:04.896743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.896743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d1f41dd3-ec17-4192-8d58-3a728e078892 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:07:04.896743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d1f41dd3-ec17-4192-8d58-3a728e078892 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009528 Sep 11 00:07:04.896743 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 350/705] 10.222.0.17 () {60 vars in 1156 bytes} [Sun Sep 11 00:07:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:07:04.902272 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-73ffbd74-9bcc-4a63-b69a-88766cad90dc tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Calling method '.version_select at 0x7f5ab6660550>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:04.931562 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-73ffbd74-9bcc-4a63-b69a-88766cad90dc tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] HTTP exception thrown: Volume tempest-invalid-692132367 could not be found. Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-73ffbd74-9bcc-4a63-b69a-88766cad90dc tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Request method failure captured: Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-692132367 HTTP/1.1 Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSaodNki82aRSmaSHTnJ88oRRMCGIVw3F_UAje0N8oP0FCWZripRt6V7LBGRi4ASZ7cn98Y0hoQTR86fe4t1kMCxhAFlNhkSD9d_uPJsaJ7MmD5qLgZ-JOJBRGKP_Z69_ud8gUk-xDPRIAKBUVBZcDEAhTTNKW5dF3YZ8IXxcf0l1rU Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:07:04.933501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e41ad56c0424e968f513b1175c599d9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}] Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 97b33ea3125442d187b9d8d4b169aab5 Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Volume tempest-invalid-692132367 could not be found. Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'tempest-invalid-692132367'} Sep 11 00:07:04.935107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-692132367 could not be found. (HTTP 404) (Request-ID: req-4c5d556a-a1d2-4f9b-9edd-39a9f847ff8b) Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.936251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 00:07:04.937460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-692132367 could not be found. Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:07:04.938558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-692132367 could not be found. Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-692132367 could not be found. Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-73ffbd74-9bcc-4a63-b69a-88766cad90dc tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Returning 404 to user: Volume tempest-invalid-692132367 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-73ffbd74-9bcc-4a63-b69a-88766cad90dc tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-692132367" status: 404 len: 98 microversion: 2.1 time: 0.036536 Sep 11 00:07:04.940451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 356/706] 10.222.0.17 () {58 vars in 1215 bytes} [Sun Sep 11 00:07:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-692132367 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 11 00:07:04.945890 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-709ed83b-c4fb-4dc1-9424-0815a49c6c84 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005258 Sep 11 00:07:04.949612 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 351/707] 10.222.0.17 () {58 vars in 1140 bytes} [Sun Sep 11 00:07:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 11 00:07:04.957069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a1c3cd8c-48e0-471a-b77f-e68254868e96 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003609 Sep 11 00:07:04.957617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 357/708] 10.222.0.17 () {58 vars in 1137 bytes} [Sun Sep 11 00:07:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 11 00:07:04.965899 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c9a5bb10-c8c4-4bdf-a9dc-c5b4c888a128 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Calling method '.version_select at 0x7f5ab66ee940>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:05.000452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-c9a5bb10-c8c4-4bdf-a9dc-c5b4c888a128 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] HTTP exception thrown: Volume 348b0d42-d2e8-42b6-92ce-dbb603ebbb9b could not be found. Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c9a5bb10-c8c4-4bdf-a9dc-c5b4c888a128 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Request method failure captured: Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: DELETE /compute/v2.1/os-volumes/348b0d42-d2e8-42b6-92ce-dbb603ebbb9b HTTP/1.1 Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSaodNki82aRSmaSHTnJ88oRRMCGIVw3F_UAje0N8oP0FCWZripRt6V7LBGRi4ASZ7cn98Y0hoQTR86fe4t1kMCxhAFlNhkSD9d_uPJsaJ7MmD5qLgZ-JOJBRGKP_Z69_ud8gUk-xDPRIAKBUVBZcDEAhTTNKW5dF3YZ8IXxcf0l1rU Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:07:05.002520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e41ad56c0424e968f513b1175c599d9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}] Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 97b33ea3125442d187b9d8d4b169aab5 Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Volume 348b0d42-d2e8-42b6-92ce-dbb603ebbb9b could not be found. Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '348b0d42-d2e8-42b6-92ce-dbb603ebbb9b'} Sep 11 00:07:05.004025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 348b0d42-d2e8-42b6-92ce-dbb603ebbb9b could not be found. (HTTP 404) (Request-ID: req-5d7f973d-c245-4a44-acac-96649c173e52) Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:05.005545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 00:07:05.007034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 348b0d42-d2e8-42b6-92ce-dbb603ebbb9b could not be found. Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 00:07:05.008365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 348b0d42-d2e8-42b6-92ce-dbb603ebbb9b could not be found. Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 348b0d42-d2e8-42b6-92ce-dbb603ebbb9b could not be found. Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c9a5bb10-c8c4-4bdf-a9dc-c5b4c888a128 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Returning 404 to user: Volume 348b0d42-d2e8-42b6-92ce-dbb603ebbb9b could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c9a5bb10-c8c4-4bdf-a9dc-c5b4c888a128 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/348b0d42-d2e8-42b6-92ce-dbb603ebbb9b" status: 404 len: 109 microversion: 2.1 time: 0.041494 Sep 11 00:07:05.009666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 352/709] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:07:04 2022] DELETE /compute/v2.1/os-volumes/348b0d42-d2e8-42b6-92ce-dbb603ebbb9b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:07:05.020811 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5a885c58-2d90-48ab-b2c1-0216ddbbf031 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Calling method '.version_select at 0x7f5ab6870310>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:05.049227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-5a885c58-2d90-48ab-b2c1-0216ddbbf031 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] HTTP exception thrown: Volume 7ef81745-1254-4f8f-b0a9-4849111e8390 could not be found. Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5a885c58-2d90-48ab-b2c1-0216ddbbf031 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Request method failure captured: Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/os-volumes/7ef81745-1254-4f8f-b0a9-4849111e8390 HTTP/1.1 Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSaodNki82aRSmaSHTnJ88oRRMCGIVw3F_UAje0N8oP0FCWZripRt6V7LBGRi4ASZ7cn98Y0hoQTR86fe4t1kMCxhAFlNhkSD9d_uPJsaJ7MmD5qLgZ-JOJBRGKP_Z69_ud8gUk-xDPRIAKBUVBZcDEAhTTNKW5dF3YZ8IXxcf0l1rU Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:07:05.051231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e41ad56c0424e968f513b1175c599d9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e41ad56c0424e968f513b1175c599d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e41ad56c0424e968f513b1175c599d9"}]}] Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 6e41ad56c0424e968f513b1175c599d9 Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-VolumesNegativeTest-1779090884 Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 97b33ea3125442d187b9d8d4b169aab5 Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-VolumesNegativeTest-1779090884-project Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Volume 7ef81745-1254-4f8f-b0a9-4849111e8390 could not be found. Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '7ef81745-1254-4f8f-b0a9-4849111e8390'} Sep 11 00:07:05.053397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ef81745-1254-4f8f-b0a9-4849111e8390 could not be found. (HTTP 404) (Request-ID: req-e47c067f-f038-42dd-a6c4-a91e41397c06) Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:05.054333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:07:05.055744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ef81745-1254-4f8f-b0a9-4849111e8390 could not be found. Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 00:07:05.056976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ef81745-1254-4f8f-b0a9-4849111e8390 could not be found. Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ef81745-1254-4f8f-b0a9-4849111e8390 could not be found. Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5a885c58-2d90-48ab-b2c1-0216ddbbf031 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] Returning 404 to user: Volume 7ef81745-1254-4f8f-b0a9-4849111e8390 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5a885c58-2d90-48ab-b2c1-0216ddbbf031 tempest-VolumesNegativeTest-1779090884 tempest-VolumesNegativeTest-1779090884-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7ef81745-1254-4f8f-b0a9-4849111e8390" status: 404 len: 109 microversion: 2.1 time: 0.036900 Sep 11 00:07:05.058363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 358/710] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Sep 11 00:07:05 2022] GET /compute/v2.1/os-volumes/7ef81745-1254-4f8f-b0a9-4849111e8390 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:07:05.542562 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:05.543348 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:05.550331 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:05.550850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:05.556686 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:05.556686 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:05.556686 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:05.556686 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:05.557808 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=100 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:05.699722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:05.708587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:05.710004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:05.711296 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1c55ddd4-446a-4857-ab07-8efb16a37b10 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1742 microversion: 2.20 time: 0.173882 Sep 11 00:07:05.711848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 353/711] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:05 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:05.787254 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:05.790975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:05.794256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:05.794774 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:05.795267 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:05.795984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:05.796435 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:05.796856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.156164 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:06.165023 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d601e2be-b73a-4528-ab46-1b8428c4b6e2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1548 microversion: 2.1 time: 0.383384 Sep 11 00:07:06.171564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 359/712] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:05 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1548 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:06.188478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:06.189793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:06.195834 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:06.196335 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:06.196867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.197570 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:06.198061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:06.198523 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.349664 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:06.358789 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ea6d81da-149d-4094-b706-c74080548c4f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1548 microversion: 2.1 time: 0.174119 Sep 11 00:07:06.359381 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 354/713] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:06 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:06.381973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:06.386888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:06.387653 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Searching by: {'deleted': False, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5'} {{(pid=121067) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 11 00:07:06.394231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:06.394733 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:06.395168 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.396427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:06.396879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:06.397301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.493756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.multi_cell_list [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121067) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 11 00:07:06.591484 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-93828c47-e260-4fcb-b342-bd2437ee0156 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213350 Sep 11 00:07:06.592127 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 360/714] 10.222.0.17 () {58 vars in 1125 bytes} [Sun Sep 11 00:07:06 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:07:06.604574 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:06.605183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:06.618318 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:06.618887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:06.619669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.620621 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:06.621154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:06.621635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.739593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:06.740214 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:06.747843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:06.748337 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:06.750372 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.751079 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:06.751876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:06.752617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:06.816487 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:06.830465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-036d6f77-c186-4630-b2cd-b41a35191c1a tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1548 microversion: 2.1 time: 0.229646 Sep 11 00:07:06.831539 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 355/715] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:06 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1548 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:07.006830 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:07.025220 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-da74b508-1d23-479d-90f1-e242ad205447 req-359e62c5-99fc-4281-b0c5-0d9782d8cfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede54ea4-13f8-4bf2-bba7-8291c078c1c8", "name": "network-vif-plugged", "status": "completed", "tag": "3a2fb6f5-4c77-4613-a8e9-31df96539e3d"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:07.039747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:07.045520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-da74b508-1d23-479d-90f1-e242ad205447 req-359e62c5-99fc-4281-b0c5-0d9782d8cfa4 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:07.046052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-da74b508-1d23-479d-90f1-e242ad205447 req-359e62c5-99fc-4281-b0c5-0d9782d8cfa4 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:07.046225 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:07.046467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-da74b508-1d23-479d-90f1-e242ad205447 req-359e62c5-99fc-4281-b0c5-0d9782d8cfa4 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:07.047494 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cd54a593-60f2-4a56-af46-01d28637ae4e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.311966 Sep 11 00:07:07.048144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 361/716] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:06 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:07.071551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-da74b508-1d23-479d-90f1-e242ad205447 req-359e62c5-99fc-4281-b0c5-0d9782d8cfa4 service nova] Creating event network-vif-plugged:3a2fb6f5-4c77-4613-a8e9-31df96539e3d for instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 on hv-cinder-85200 Sep 11 00:07:07.086628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-da74b508-1d23-479d-90f1-e242ad205447 req-359e62c5-99fc-4281-b0c5-0d9782d8cfa4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065536 Sep 11 00:07:07.091303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 356/717] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:07:08.078876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:08.079491 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:08.088554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:08.089554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:08.090217 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:08.095650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:08.096377 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:08.096809 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:08.339115 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:08.349233 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:08.351021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:08.352474 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-79431f99-e17a-4bf3-97cd-8856d64771fd tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.282425 Sep 11 00:07:08.353199 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 362/718] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:08 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:07:09.358736 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c500721f-b554-4640-a19c-f8a676d17389"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:09.362125 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:09.370157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:09.371031 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:09.371634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:09.372897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:09.373514 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:09.374475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:09.381486 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:09.383008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:09.395176 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:09.396673 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:09.398623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:09.399638 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:09.401187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:09.402792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:09.607322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:09.616578 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:09.618554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:09.619760 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-81606af9-3012-4dfa-8efc-ea44c12f62f5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.242979 Sep 11 00:07:09.620846 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 363/719] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:09 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:10.648449 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:10.649155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:10.655771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:10.656242 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:10.656671 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:10.657348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:10.657790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:10.658207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:10.690440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-745f1f1a-9266-4cd7-acfb-f636700b613e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "POST /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.336276 Sep 11 00:07:10.691226 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 357/720] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:07:09 2022] POST /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments => generated 194 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:10.890398 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:10.905913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:10.907941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:10.909455 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-834d50ef-e599-4b71-aca2-bbf643979f06 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.265389 Sep 11 00:07:10.910234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 364/721] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:10 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:11.938564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:11.941079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:11.954209 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:11.956037 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:11.956643 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:11.957616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:11.958420 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:11.959086 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:12.154550 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:12.167525 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:12.169667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:12.171166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-272246e1-a133-4fc3-842d-1eb30e4bc1e6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.238349 Sep 11 00:07:12.172583 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 358/722] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:11 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:07:13.204161 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:13.205060 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:13.220060 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:13.220856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:13.222286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:13.223217 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:13.223670 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:13.225121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:13.507118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:13.516147 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:13.517867 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:13.519281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fba44680-e3eb-4541-9eff-74501b259e7c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.320097 Sep 11 00:07:13.520345 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 365/723] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:13 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:14.546120 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:14.547827 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:14.550781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=74 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:14.557779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:14.558272 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:14.559806 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:14.559806 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:14.560011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:14.560356 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:14.801777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:14.815887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:14.817470 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:14.818840 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-64d9b2ce-de0f-4029-9f4e-9135676c7c7b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.277304 Sep 11 00:07:14.819732 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 359/724] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:14 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:15.847234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:15.848711 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:15.855675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:15.856358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:15.857041 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:15.857912 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:15.858689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:15.859271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:16.018922 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:16.027551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:16.028986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:16.030149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b16bf6c6-73d8-4ee0-b541-29ff4d3279aa tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.187710 Sep 11 00:07:16.030732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 366/725] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:15 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:17.060626 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:17.063002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:17.073858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:17.076517 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:17.077972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:17.079381 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:17.080098 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:17.081952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:17.263593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:17.263593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:17.264719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:17.264719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f9756be4-5c4e-4d86-a5f4-2e86a8aba4a9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.197449 Sep 11 00:07:17.264719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 360/726] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:17 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:18.286048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:18.287320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:18.306970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:18.312458 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:18.312938 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:18.313365 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:18.314144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:18.314501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:18.314937 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:18.469376 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:18.480185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:18.480185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:18.481349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-92027466-37d0-4ea6-94d6-f9f55c057ff3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1737 microversion: 2.20 time: 0.199075 Sep 11 00:07:18.482519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 367/727] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:18 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:18.502932 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:18.503657 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:18.510453 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:18.510970 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:18.511411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:18.512184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:18.514843 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:18.514843 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:18.659701 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:18.669109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7c89a59d-26fd-48b7-8055-48a087985234 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1594 microversion: 2.1 time: 0.170535 Sep 11 00:07:18.669674 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 361/728] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:18 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1594 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:19.509350 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:19.509959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:19.517013 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:19.517267 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:19.517695 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:19.518389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:19.519396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:19.519396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:19.728556 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:19.736804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:19.738250 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:19.739463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-27c55722-faee-40a0-b4c0-459028d67103 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1719 microversion: 2.20 time: 0.234694 Sep 11 00:07:19.742412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 368/729] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:19 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:20.765405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:20.766017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:20.773961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:20.774447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:20.774919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:20.775620 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:20.776082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:20.776509 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:20.981653 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:20.989961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:20.991848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:20.993112 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-595acfc1-07fb-41b7-b649-25d1bf4c6f28 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1719 microversion: 2.20 time: 0.231575 Sep 11 00:07:20.993747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 362/730] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:20 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:21.204282 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-6cf21c95-4d41-4ea8-bfe7-5643b7629926 req-32d27aba-7047-4890-8727-d4147214d57d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7275256b-8e7b-4327-924b-fdde977cb722", "tag": "e95bb83f-e43c-448b-9195-7dc5592a9c51"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:21.216308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6cf21c95-4d41-4ea8-bfe7-5643b7629926 req-32d27aba-7047-4890-8727-d4147214d57d service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:21.216871 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6cf21c95-4d41-4ea8-bfe7-5643b7629926 req-32d27aba-7047-4890-8727-d4147214d57d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:21.217917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6cf21c95-4d41-4ea8-bfe7-5643b7629926 req-32d27aba-7047-4890-8727-d4147214d57d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:21.233831 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-6cf21c95-4d41-4ea8-bfe7-5643b7629926 req-32d27aba-7047-4890-8727-d4147214d57d service nova] Creating event network-changed:e95bb83f-e43c-448b-9195-7dc5592a9c51 for instance 7275256b-8e7b-4327-924b-fdde977cb722 on hv-cinder-85200 Sep 11 00:07:21.240316 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-6cf21c95-4d41-4ea8-bfe7-5643b7629926 req-32d27aba-7047-4890-8727-d4147214d57d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165078 Sep 11 00:07:21.244302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 369/731] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:07:22.028968 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:22.029745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:22.036712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:22.041861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:22.042408 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:22.043160 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:22.043628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:22.044061 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:22.228313 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:22.238857 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:22.245289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:22.245289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ab84d131-c88c-4ccf-a86b-b8eed80b32b1 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1719 microversion: 2.20 time: 0.226021 Sep 11 00:07:22.245289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 363/732] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:22 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:22.914129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-5c772cc3-fd39-49a2-930c-d9ad1b3aa66c req-320b8454-aefe-4516-966b-b858e08da9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede54ea4-13f8-4bf2-bba7-8291c078c1c8", "name": "network-vif-unplugged", "status": "completed", "tag": "3a2fb6f5-4c77-4613-a8e9-31df96539e3d"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:22.921350 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=56 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:22.926860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-5c772cc3-fd39-49a2-930c-d9ad1b3aa66c req-320b8454-aefe-4516-966b-b858e08da9e3 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:22.927544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-5c772cc3-fd39-49a2-930c-d9ad1b3aa66c req-320b8454-aefe-4516-966b-b858e08da9e3 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:22.928283 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-5c772cc3-fd39-49a2-930c-d9ad1b3aa66c req-320b8454-aefe-4516-966b-b858e08da9e3 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:22.939707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-5c772cc3-fd39-49a2-930c-d9ad1b3aa66c req-320b8454-aefe-4516-966b-b858e08da9e3 service nova] Creating event network-vif-unplugged:3a2fb6f5-4c77-4613-a8e9-31df96539e3d for instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 on hv-cinder-85200 Sep 11 00:07:22.945595 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-5c772cc3-fd39-49a2-930c-d9ad1b3aa66c req-320b8454-aefe-4516-966b-b858e08da9e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037164 Sep 11 00:07:22.946382 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 370/733] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:07:23.270299 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:23.270299 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:23.277019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:23.277456 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:23.278199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:23.278946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:23.279403 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:23.279825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:23.416465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:23.424640 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:23.426057 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:23.427967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-79114e6f-c449-4072-8ed0-0fa9b9ddf61b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1662 microversion: 2.20 time: 0.163259 Sep 11 00:07:23.428905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 364/734] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:23 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:23.454607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3845bd1-818f-47cb-b3c0-ab108026f8ac"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:23.457129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:23.463929 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:23.464660 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:23.465277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:23.465970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:23.466457 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:23.467099 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:23.484730 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:23.650638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-636527872"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:23.651191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:23.657109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:23.657607 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:23.658263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:23.658989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:23.659437 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:23.659847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:23.794971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.network.security_group_api [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Adding security group cccf3aaa-0dc0-4a9e-972b-db00a3127a9a to port e95bb83f-e43c-448b-9195-7dc5592a9c51 Sep 11 00:07:24.240902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-42f13fda-bc55-4220-bcbc-f5618790502f tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "POST /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/action" status: 202 len: 0 microversion: 2.1 time: 0.594018 Sep 11 00:07:24.241638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 365/735] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:07:23 2022] POST /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:07:24.249749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:24.250372 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:24.257640 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:24.258157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:24.258604 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:24.259555 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:24.260014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:24.260551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:24.451895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:24.461821 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ff55aa21-859f-4686-982e-e27c62c57b9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1759 microversion: 2.1 time: 0.215524 Sep 11 00:07:24.463321 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 366/736] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:24 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1759 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:07:24.468882 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-63f1e20a-9271-4753-9fb4-a4de1ef3320d req-0eecf511-37a2-41e5-97b9-7e9ea3c36607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7275256b-8e7b-4327-924b-fdde977cb722", "tag": "e95bb83f-e43c-448b-9195-7dc5592a9c51"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:24.480449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-63f1e20a-9271-4753-9fb4-a4de1ef3320d req-0eecf511-37a2-41e5-97b9-7e9ea3c36607 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:24.485789 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-63f1e20a-9271-4753-9fb4-a4de1ef3320d req-0eecf511-37a2-41e5-97b9-7e9ea3c36607 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:24.485789 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-63f1e20a-9271-4753-9fb4-a4de1ef3320d req-0eecf511-37a2-41e5-97b9-7e9ea3c36607 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:24.495452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-63f1e20a-9271-4753-9fb4-a4de1ef3320d req-0eecf511-37a2-41e5-97b9-7e9ea3c36607 service nova] Creating event network-changed:e95bb83f-e43c-448b-9195-7dc5592a9c51 for instance 7275256b-8e7b-4327-924b-fdde977cb722 on hv-cinder-85200 Sep 11 00:07:24.500406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-63f1e20a-9271-4753-9fb4-a4de1ef3320d req-0eecf511-37a2-41e5-97b9-7e9ea3c36607 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035812 Sep 11 00:07:24.501063 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 367/737] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:24.555294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-71d24048-8abe-4ec9-bad0-35aaba58ac90 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.105804 Sep 11 00:07:24.556940 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 371/738] 10.222.0.17 () {62 vars in 1364 bytes} [Sun Sep 11 00:07:23 2022] POST /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/os-volume_attachments => generated 188 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 00:07:24.730541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:24.730541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:24.734242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:24.734833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:24.735452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:24.736317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:24.736930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:24.737585 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:24.941861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:25.336827 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9915c845-1c49-4815-b278-b580aa766ea8 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/os-volume_attachments/e3845bd1-818f-47cb-b3c0-ab108026f8ac" status: 202 len: 0 microversion: 2.20 time: 0.614374 Sep 11 00:07:25.337466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 368/739] 10.222.0.17 () {60 vars in 1457 bytes} [Sun Sep 11 00:07:24 2022] DELETE /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/os-volume_attachments/e3845bd1-818f-47cb-b3c0-ab108026f8ac => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:07:25.403746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:25.404338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:25.411063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:25.411690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:25.412250 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:25.412952 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:25.413404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:25.413826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:25.478686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121067) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 00:07:25.746883 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-629971b5-81a5-42e5-8878-75b308d79238 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "POST /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/action" status: 202 len: 0 microversion: 2.20 time: 0.347128 Sep 11 00:07:25.754652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 372/740] 10.222.0.17 () {62 vars in 1319 bytes} [Sun Sep 11 00:07:25 2022] POST /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:07:25.760449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:25.761639 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:25.771617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:25.772127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:25.772559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:25.773294 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:25.773930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:25.774389 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:25.924628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:25.925132 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:25.934267 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:25.934832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:25.935606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:25.936633 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:25.937103 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:25.937540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:25.939266 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:25.956763 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:25.959709 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:25.961815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-88083e7d-f65f-4d48-9207-865665746fd6 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1670 microversion: 2.20 time: 0.206213 Sep 11 00:07:25.964513 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 369/741] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:25 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:25.973406 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-654ac21e-4451-4672-b36b-6009b6b08854 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/ips" status: 200 len: 145 microversion: 2.1 time: 0.058480 Sep 11 00:07:25.975574 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 373/742] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:07:25 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/ips => generated 145 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:26.993804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:26.994471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:27.001674 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:27.002095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:27.002577 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:27.003304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:27.003755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:27.004176 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:27.147885 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:27.155918 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:27.157329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:27.158467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-162791fc-94d1-4d4d-9044-51fc2cc9ef70 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1670 microversion: 2.20 time: 0.170435 Sep 11 00:07:27.159041 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 370/743] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:26 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:27.641807 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02671d25-17a8-495b-97b9-437a8589a470"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:27.644786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:27.652622 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:27.653136 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:27.653597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:27.654286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:27.654756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:27.655177 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:28.184305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:28.185528 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:28.192107 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:28.192593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:28.193559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:28.194609 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:28.195095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:28.195517 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:28.336058 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:28.344119 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:28.345542 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:28.346722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b7543762-9005-4fb8-bcc6-f3b3f18abb33 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.166420 Sep 11 00:07:28.347277 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 371/744] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:28 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:28.484027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-79dc01ca-5f58-4980-a7db-63d980799b5e tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846138 Sep 11 00:07:28.484733 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 374/745] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:07:27 2022] POST /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:29.375921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:29.376533 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:29.383834 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:29.384322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:29.384768 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:29.385474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:29.385928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:29.386350 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:29.529520 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:29.537739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:29.539175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:29.540335 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c31200c3-406b-48c5-b57b-959a76ab1e08 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.168313 Sep 11 00:07:29.540898 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 372/746] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:29 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:30.568020 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:30.569341 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:30.576078 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:30.576773 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:30.577374 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:30.578069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:30.578511 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:30.579129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:30.747661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:30.754235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:30.756039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:30.757585 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-49d6cb2f-2ae7-4325-90b0-a9c34784f60d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.194602 Sep 11 00:07:30.758475 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 375/747] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:30 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:31.784038 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:31.784639 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:31.792935 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:31.793418 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:31.793889 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:31.794595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:31.795079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:31.795496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:31.950010 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:31.962033 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:31.964616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:31.966307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ca2557fe-d137-4f7d-8d75-57c0bfa14a6b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.186486 Sep 11 00:07:31.979094 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 373/748] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:31 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:32.995902 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:32.996669 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:33.003606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:33.004163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:33.005572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:33.005572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:33.011536 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:33.012003 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:33.164882 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:33.173555 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:33.175322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:33.176514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f3246a0c-11b2-4747-92f4-5304e643659c tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.187267 Sep 11 00:07:33.178085 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 376/749] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:32 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:34.204671 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:34.205587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:34.212943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:34.213427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:34.213860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:34.219963 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:34.219963 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:34.219963 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:34.389004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:34.398725 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:34.400191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:34.401338 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6a13b859-4e6f-4eb1-96a8-152e3145d733 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.200756 Sep 11 00:07:34.401893 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 374/750] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:34 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:35.428408 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:35.429017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:35.435783 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:35.436266 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:35.436699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:35.437391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:35.437836 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:35.438255 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:35.578821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:35.587538 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:35.588974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:35.590130 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8693db18-b352-4729-9732-3594052ff13d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.166525 Sep 11 00:07:35.606704 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 377/751] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:35 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:36.616824 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:36.617404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:36.624159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:36.624878 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:36.625514 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:36.626392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:36.627031 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:36.627610 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:36.773465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:36.782170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:36.783722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:36.784874 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7169420d-c715-4ec4-ad51-7943b28fea11 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.172788 Sep 11 00:07:36.785426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 375/752] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:36 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:37.814184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:37.814842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:37.824017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:37.825186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:37.825746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:37.826600 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:37.827219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:37.827749 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:38.023250 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:38.042197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:38.042197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:38.042197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9e7b7110-60b7-47df-b438-d188a828fa58 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.224083 Sep 11 00:07:38.042524 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 378/753] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:37 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:07:39.060947 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:39.061547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:39.067917 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:39.069122 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:39.069658 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:39.070338 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:39.070812 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:39.071231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:39.201533 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:39.210138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:39.211675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:39.212843 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c6b6ef2b-62e1-4fb0-a726-b702dd16ac50 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.156023 Sep 11 00:07:39.213689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 376/754] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:39 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:40.237834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:40.239459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:40.248673 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:40.249317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:40.249923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:40.250720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:40.251228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:40.251702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:40.401216 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:40.409475 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:40.410931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:40.412399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b260b5c5-c27d-4ddc-9072-d15639f81f5e tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.178998 Sep 11 00:07:40.413096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 379/755] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:40 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:41.438486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:41.439126 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:41.446738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:41.447224 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:41.447662 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:41.448546 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:41.448816 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:41.449237 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:41.477366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:41.479636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:41.486099 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:41.490630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:41.490630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:41.490630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:41.490630 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:41.491029 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:41.524892 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f92323bf-b661-4b20-b626-c716a0410e4d tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051725 Sep 11 00:07:41.525773 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 380/756] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:07:41 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:07:41.536271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:41.536786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:41.542895 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:41.543380 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:41.543817 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:41.544515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:41.544965 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:41.545387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:41.603057 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:41.625204 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:41.627950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:41.627950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b2aca85f-07f2-4162-9ba6-540a0626a137 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.193665 Sep 11 00:07:41.628514 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 377/757] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:41 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:07:41.743515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b96f6d6d-2e62-4b3d-9a4c-ca59b39209b4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/02671d25-17a8-495b-97b9-437a8589a470" status: 200 len: 194 microversion: 2.1 time: 0.210975 Sep 11 00:07:41.744103 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 381/758] 10.222.0.17 () {58 vars in 1413 bytes} [Sun Sep 11 00:07:41 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/02671d25-17a8-495b-97b9-437a8589a470 => generated 194 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:07:42.656192 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:42.656883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:42.663868 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:42.667847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:42.667847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:42.667847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:42.667847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:42.668225 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:42.804818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:42.812951 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:42.814430 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:42.815577 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3c076053-d84e-4036-b37a-9c32165c6278 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.163435 Sep 11 00:07:42.816154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 378/759] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:42 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:43.071703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-743baf1e-0c79-4c8a-84ae-515082511f7f req-f7bcb39b-7123-4be2-8f4e-c966534aacb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede54ea4-13f8-4bf2-bba7-8291c078c1c8", "name": "network-vif-plugged", "status": "completed", "tag": "3a2fb6f5-4c77-4613-a8e9-31df96539e3d"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:43.082928 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-743baf1e-0c79-4c8a-84ae-515082511f7f req-f7bcb39b-7123-4be2-8f4e-c966534aacb9 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:43.083708 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-743baf1e-0c79-4c8a-84ae-515082511f7f req-f7bcb39b-7123-4be2-8f4e-c966534aacb9 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:43.084359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-743baf1e-0c79-4c8a-84ae-515082511f7f req-f7bcb39b-7123-4be2-8f4e-c966534aacb9 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:43.095108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-743baf1e-0c79-4c8a-84ae-515082511f7f req-f7bcb39b-7123-4be2-8f4e-c966534aacb9 service nova] Creating event network-vif-plugged:3a2fb6f5-4c77-4613-a8e9-31df96539e3d for instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 on hv-cinder-85200 Sep 11 00:07:43.100436 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-743baf1e-0c79-4c8a-84ae-515082511f7f req-f7bcb39b-7123-4be2-8f4e-c966534aacb9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033137 Sep 11 00:07:43.101042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 382/760] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:43.354206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1467773a-ecb4-4021-a332-857e63e8073e"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:43.356635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:43.363888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:43.363888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:43.363888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:43.364271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:43.364668 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:43.365713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:43.841847 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:43.842550 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:43.848645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:43.849155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:43.850415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:43.851152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:43.851609 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:43.852030 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:43.997163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:44.008531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:44.011666 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:44.011666 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-80a93e7f-47f4-42a8-82d5-12d82b6c9fb9 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.173642 Sep 11 00:07:44.011924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 383/761] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:43 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:07:44.342849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e1fee726-b574-4ac3-9ca4-37f479ebe5e2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "POST /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991323 Sep 11 00:07:44.342849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 379/762] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:07:43 2022] POST /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:45.037382 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:45.037917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:45.044207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:45.044683 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:45.045168 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:45.045785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:45.046228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:45.046645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:45.050783 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:45.184903 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:45.201555 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:45.203114 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:45.204508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bfab5397-9688-434e-a088-1efc30b09a17 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1728 microversion: 2.20 time: 0.171118 Sep 11 00:07:45.219058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 384/763] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:45 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:46.232939 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:46.233839 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:46.238212 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=42 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:46.244074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:46.244554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:46.245016 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:46.245705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:46.246147 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:46.246564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:46.378328 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:46.387516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:46.388936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:46.390082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c9c93cf4-e8aa-409c-97ba-ec1db1ba38de tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1715 microversion: 2.20 time: 0.161888 Sep 11 00:07:46.390635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 380/764] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:07:46 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:07:46.817269 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:46.820154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:46.827107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:46.827591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:46.828030 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:46.828720 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:46.829208 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:46.829635 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:47.021444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3cec467c-ef73-416b-91d1-35970af2e5ba tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "POST /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/action" status: 202 len: 0 microversion: 2.1 time: 0.208524 Sep 11 00:07:47.022280 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 385/765] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:07:46 2022] POST /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:07:47.030244 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:47.031126 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:47.038169 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:47.039056 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:47.039688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:47.040393 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:47.040836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:47.041261 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:47.210931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:47.219403 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-daf8e9b4-4913-4081-9d77-1c5ce5ecc1d7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1751 microversion: 2.1 time: 0.192963 Sep 11 00:07:47.220074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 381/766] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:47 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:48.246093 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:48.246894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:48.253049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:48.253600 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:48.254114 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:48.254891 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:48.255401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:48.256465 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:48.546749 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:48.555980 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-aa85a958-cff5-48b0-b8e4-46b4581bd455 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.314593 Sep 11 00:07:48.556554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 386/767] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:48 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:49.584565 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:49.585275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:49.592607 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:49.593542 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:49.594000 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:49.594818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:49.595213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:49.595801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:49.780219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:49.784297 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=93,nova_cell1:UPDATE=5 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:49.790474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6f6da4b6-d15b-48c4-9740-36a5df0adf80 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.210616 Sep 11 00:07:49.791231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 382/768] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:49 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:50.821396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:50.821396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:50.824380 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:50.826797 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:50.827313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:50.828123 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:50.828488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:50.828910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:51.293545 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:51.307957 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d345a3bd-8da9-446f-9bff-ef8c8c73039e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.498380 Sep 11 00:07:51.308537 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 387/769] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:50 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:52.331994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:52.332744 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:52.340760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:52.341330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:52.341987 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:52.342787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:52.343304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:52.343974 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:52.531699 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:52.540747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b20407bb-a6d6-4713-b128-361b96d42129 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.212737 Sep 11 00:07:52.546212 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 383/770] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:52 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:53.033809 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:53.036206 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:53.049150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:53.049564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:53.050598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:53.051758 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:53.052920 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:53.053451 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:53.087509 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5d361cf4-bc68-4262-943c-7c49febfabec tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057717 Sep 11 00:07:53.088084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 388/771] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:07:53 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:53.232929 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:53.233710 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:53.240972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:53.241754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:53.242197 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:53.243110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:53.243741 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:53.244166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:53.275145 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8cb761d1-4451-45d4-b0ff-519b0164ea2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/02671d25-17a8-495b-97b9-437a8589a470" status: 200 len: 194 microversion: 2.1 time: 0.046352 Sep 11 00:07:53.281261 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 384/772] 10.222.0.17 () {58 vars in 1413 bytes} [Sun Sep 11 00:07:53 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/02671d25-17a8-495b-97b9-437a8589a470 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:53.286358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:53.288123 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:53.294473 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:53.295215 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:53.295845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:53.296870 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:53.297507 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:53.297937 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:53.385685 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lazy-loading 'services' on Instance uuid 71a07dfc-a3f1-4042-9748-7a0a82da7a81 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:07:53.564935 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:53.565555 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:53.572040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:53.572512 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:53.572936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:53.573613 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:53.574077 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:53.574500 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:53.703416 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f5a81e89-72b6-4dc7-a551-a78d8c79df2f tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/02671d25-17a8-495b-97b9-437a8589a470" status: 202 len: 0 microversion: 2.1 time: 0.420828 Sep 11 00:07:53.706064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 389/773] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:07:53 2022] DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/02671d25-17a8-495b-97b9-437a8589a470 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:07:53.829117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:53.837767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d20a0fd2-6f26-47e7-903b-7384f8a41bfe tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.276681 Sep 11 00:07:53.838421 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 385/774] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:53 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:07:54.888575 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:54.889877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:54.893058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:07:54.924233 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:54.924802 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:54.925314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:54.926096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:54.926620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:54.927185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:55.144975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:55.154721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d39b84d2-e60a-4611-9e31-fbb7f47273be tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.294889 Sep 11 00:07:55.155893 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 390/775] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:54 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:55.994105 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:55.994651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:55.997329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 00:07:55.997519 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Sun Sep 11 00:07:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/1467773a-ecb4-4021-a332-857e63e8073e (ip 10.222.0.17) !!! Sep 11 00:07:56.004107 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:56.006013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:56.006013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:56.006304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:56.006789 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:56.007220 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:56.040801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3e51d26c-ce16-4cb2-8e4f-d827ea58ad72 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/1467773a-ecb4-4021-a332-857e63e8073e" status: 200 len: 194 microversion: 2.1 time: 0.050684 Sep 11 00:07:56.041401 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 386/776] 10.222.0.17 () {58 vars in 1413 bytes} [Sun Sep 11 00:07:55 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/1467773a-ecb4-4021-a332-857e63e8073e => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:07:56.052331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:56.053018 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:56.060148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:56.060625 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:56.061055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:56.061741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:56.062184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:56.062597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:56.156042 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lazy-loading 'services' on Instance uuid 71a07dfc-a3f1-4042-9748-7a0a82da7a81 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:07:56.178823 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:56.179376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:56.186968 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:56.187747 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:56.188396 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:56.189269 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:56.189900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:56.194493 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:56.411245 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2e3d3da1-e3cb-4d8c-ba37-a7ccfa38f4d9 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/1467773a-ecb4-4021-a332-857e63e8073e" status: 202 len: 0 microversion: 2.1 time: 0.362680 Sep 11 00:07:56.413055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 391/777] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:07:56 2022] DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments/1467773a-ecb4-4021-a332-857e63e8073e => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:07:56.671667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:56.681307 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7188ae21-e354-4237-b38c-05d173d6d740 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.506558 Sep 11 00:07:56.681933 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 387/778] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:56 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:07:57.657287 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:57.660257 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:57.673582 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:57.674073 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:57.674499 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:57.675238 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:57.675715 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:57.676134 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:57.706705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:57.707395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:57.722040 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cfbafb64-53ff-4eb4-b201-f3c7c533d805 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079689 Sep 11 00:07:57.724029 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:57.725026 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:57.725512 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:57.726444 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:57.726919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:57.727343 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:57.731563 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 392/779] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:07:57 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 11 00:07:57.891250 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:57.894037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:57.903084 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:57.904195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:57.904847 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:57.905796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:57.907097 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:57.910387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:57.910532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:57.920005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-60936ba2-1bc5-4366-b5bd-b7a603af3bb3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.219107 Sep 11 00:07:57.920833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 388/780] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:57 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:07:57.962860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-74e003c8-07cb-4011-b59b-9d84bf3b18ff tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075883 Sep 11 00:07:57.963899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 393/781] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:07:57 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 11 00:07:58.038630 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:58.040030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:58.050805 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:58.051563 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:58.052184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:58.053250 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:58.053892 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:58.054551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:58.082500 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Going to try to terminate instance {{(pid=121068) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:07:58.377387 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8ca4393b-f974-4662-ad4b-87eae043e3c2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 204 len: 0 microversion: 2.1 time: 0.344508 Sep 11 00:07:58.378291 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 389/782] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:07:58 2022] DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:07:58.387138 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:58.387751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:58.393546 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:58.394026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:58.394460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:58.395174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:58.395621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:58.396691 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:58.600583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:58.616188 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fc20fdac-3f49-4dac-b53b-89b3d150fe2b tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1672 microversion: 2.1 time: 0.232840 Sep 11 00:07:58.618354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 394/783] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:58 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:58.945750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:58.951447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:58.961866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:58.962990 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:58.963563 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:58.964598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:58.965178 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:58.965606 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:59.148595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:59.157428 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8cf2da26-4af2-4202-adcf-207f367b168e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.217345 Sep 11 00:07:59.158004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 390/784] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:58 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:07:59.363060 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-58da34e5-bfb5-4337-a35f-a0774605034a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Action: 'create', calling method: .version_select at 0x7f5ab6778f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1175751162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV79vm16cMvUHDM/xzJ4VlZidYSBGv//CIGkhYGUHZiolchmZs35PE0zJZGnBSL/6OAwPG5EdCxJvI997/R66TkCr8YvxcAhTshcYX2DW6OUU9kcrjSw8Ivb3ZTDnxCvQ=="}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:07:59.379536 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-58da34e5-bfb5-4337-a35f-a0774605034a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Getting quotas for project 49b0d0136b404c68902274c0e571fb3a. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:07:59.384435 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-58da34e5-bfb5-4337-a35f-a0774605034a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Getting quotas for user 32b5ea2215fd4c38aabaf375db991d06 and project 49b0d0136b404c68902274c0e571fb3a. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:07:59.470198 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-58da34e5-bfb5-4337-a35f-a0774605034a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.311783 Sep 11 00:07:59.470837 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 395/785] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:07:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:07:59.640352 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:07:59.640970 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:07:59.648491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:59.649278 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:59.649867 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:59.650760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:07:59.651216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:07:59.657824 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:07:59.794625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:07:59.803138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d7f3a1cf-9947-4dc2-ba25-4c57b3dae5c8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1672 microversion: 2.1 time: 0.166542 Sep 11 00:07:59.803646 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 391/786] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:07:59 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:00.185196 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:00.185820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:00.194997 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:00.195493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:00.195931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:00.196662 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:00.197114 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:00.197542 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:00.389927 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:00.398501 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b110a772-9319-4e71-ac97-dad6b5e9d117 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.217768 Sep 11 00:08:00.399106 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 396/787] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:00 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:00.828695 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:00.829302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:00.836728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:00.837349 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:00.837717 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:00.838412 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:00.838896 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:00.840671 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:00.982627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:00.993294 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-aba6d82b-819e-4e0a-8e3b-56f4c04a2d2c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1672 microversion: 2.1 time: 0.168239 Sep 11 00:08:00.993994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 392/788] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:00 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:01.422321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:01.422960 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:01.430014 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:01.430499 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:01.430963 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:01.431656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:01.432106 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:01.432522 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:01.537327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-ff409cba-da68-476e-8c37-e2244d6f862c req-42dcd65d-736d-47f9-8104-8f01857f5d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a07dfc-a3f1-4042-9748-7a0a82da7a81", "name": "network-vif-deleted", "tag": "81e5dc9c-6d72-46e8-b3a7-c64798c7d90f"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:01.566950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ff409cba-da68-476e-8c37-e2244d6f862c req-42dcd65d-736d-47f9-8104-8f01857f5d64 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:01.567635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ff409cba-da68-476e-8c37-e2244d6f862c req-42dcd65d-736d-47f9-8104-8f01857f5d64 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:01.569010 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ff409cba-da68-476e-8c37-e2244d6f862c req-42dcd65d-736d-47f9-8104-8f01857f5d64 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:01.587589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-ff409cba-da68-476e-8c37-e2244d6f862c req-42dcd65d-736d-47f9-8104-8f01857f5d64 service nova] Creating event network-vif-deleted:81e5dc9c-6d72-46e8-b3a7-c64798c7d90f for instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 on hv-cinder-85200 Sep 11 00:08:01.594375 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-ff409cba-da68-476e-8c37-e2244d6f862c req-42dcd65d-736d-47f9-8104-8f01857f5d64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064045 Sep 11 00:08:01.595399 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 393/789] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:08:01.638092 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:01.648272 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5f0657c8-29f7-4ab7-a46d-97841c007a9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.229748 Sep 11 00:08:01.649599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 397/790] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:01 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:02.024162 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:02.026324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:02.035067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:02.035737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:02.036331 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:02.037863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:02.038488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:02.039167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:02.074911 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:02.075660 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:02.076096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:02.076538 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lazy-loading 'fault' on Instance uuid 71a07dfc-a3f1-4042-9748-7a0a82da7a81 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:08:02.143443 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9950f578162449c0845c3aa4aab692d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f0209a8e48496c8d88c885f8364cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:02.151978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c41ddad6-bd33-4c82-8cb8-182495391e8c tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 200 len: 1327 microversion: 2.1 time: 0.136942 Sep 11 00:08:02.153532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 394/791] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:02 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:02.673815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:02.675602 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:02.684755 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:02.685449 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:02.686205 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:02.686976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:02.687427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:02.688039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:02.884881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:02.894614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-005ca0d0-b11a-42d4-93b0-037640bf93c9 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.225034 Sep 11 00:08:02.911301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 398/792] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:02 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:03.176779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:03.177930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:03.184314 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:03.184794 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:03.185419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:03.186170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:03.186618 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:03.187110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:03.202136 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] HTTP exception thrown: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Request method failure captured: Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 HTTP/1.1 Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVDz39WI8zSFD3sAxjj3AauZVU_YuIF61kZ9zSVTuvhSWeCR_4FJKf132MV4J6IpQlpIwvHoVlNnJhyEI1e7wpiNct6lt4c1TfyVx1bN2Gr_1RtrQHP1Qz08ttHxVn_uXjY45Jkz8-I6eAKw0vCLkrDy2z8MQ4SuqYY-aMRjURVXkQ Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:08:03.203815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_65f0209a8e48496c8d88c885f8364cbd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}] Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 9950f578162449c0845c3aa4aab692d4 Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:03.205496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '71a07dfc-a3f1-4042-9748-7a0a82da7a81'} Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:03.209952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:03.211566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:03.212836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Returning 404 to user: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:03.212836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-af2f0195-a859-4e74-b9ba-d7fba2d6ce67 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 404 len: 111 microversion: 2.1 time: 0.032470 Sep 11 00:08:03.212836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 395/793] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:03 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:08:03.214625 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8cbf19ea-6c3f-4741-9a73-434f6fc4bed8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '.version_select at 0x7f5ab6778dc0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:03.300478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8cbf19ea-6c3f-4741-9a73-434f6fc4bed8 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365299840" status: 202 len: 0 microversion: 2.1 time: 0.089929 Sep 11 00:08:03.301454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 399/794] 10.222.0.17 () {58 vars in 1218 bytes} [Sun Sep 11 00:08:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365299840 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:08:03.919655 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:03.920646 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:03.927398 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:03.928570 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:03.929226 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:03.930452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:03.931394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:03.932369 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:04.108000 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:04.117436 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6cb48f44-4033-4b51-aafa-86ae8fc607ce tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.201744 Sep 11 00:08:04.118571 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 396/795] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:03 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:05.141920 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:05.142537 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:05.150009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:05.150496 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:05.150970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:05.151701 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:05.152148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:05.152747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:05.173733 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:05.319107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:05.328652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1af946a7-f79c-4928-9cc7-3bbad7770be0 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.191038 Sep 11 00:08:05.329573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 400/796] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:05 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:06.353001 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:06.353619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:06.360059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:06.360537 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:06.364779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:06.364779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:06.364779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:06.364779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:06.515744 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:06.525572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-420b302e-7cd8-414a-9e44-1514bde20e9e tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.177155 Sep 11 00:08:06.526149 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 397/797] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:06 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:06.977743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:06.978388 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:06.986081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:06.986492 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:06.986963 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:06.987667 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:06.988124 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:06.988553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:07.002858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] HTTP exception thrown: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Request method failure captured: Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 HTTP/1.1 Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVDz39WI8zSFD3sAxjj3AauZVU_YuIF61kZ9zSVTuvhSWeCR_4FJKf132MV4J6IpQlpIwvHoVlNnJhyEI1e7wpiNct6lt4c1TfyVx1bN2Gr_1RtrQHP1Qz08ttHxVn_uXjY45Jkz8-I6eAKw0vCLkrDy2z8MQ4SuqYY-aMRjURVXkQ Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:08:07.004527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_65f0209a8e48496c8d88c885f8364cbd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}] Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 9950f578162449c0845c3aa4aab692d4 Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.006415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '71a07dfc-a3f1-4042-9748-7a0a82da7a81'} Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:07.007315 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.008732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.010236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Returning 404 to user: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:07.010236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5c10c5a6-0294-432b-a5d1-d6d806ae869a tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 404 len: 111 microversion: 2.1 time: 0.033384 Sep 11 00:08:07.010236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 401/798] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:08:06 2022] DELETE /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:08:07.014446 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:07.019374 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 71a07dfc-a3f1-4042-9748-7a0a82da7a81] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:07.021665 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:07.022363 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:07.023050 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:07.023922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:07.024379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:07.024928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:07.040635 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] HTTP exception thrown: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Request method failure captured: Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 HTTP/1.1 Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVDz39WI8zSFD3sAxjj3AauZVU_YuIF61kZ9zSVTuvhSWeCR_4FJKf132MV4J6IpQlpIwvHoVlNnJhyEI1e7wpiNct6lt4c1TfyVx1bN2Gr_1RtrQHP1Qz08ttHxVn_uXjY45Jkz8-I6eAKw0vCLkrDy2z8MQ4SuqYY-aMRjURVXkQ Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:08:07.042170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_65f0209a8e48496c8d88c885f8364cbd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}] Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 9950f578162449c0845c3aa4aab692d4 Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.043726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '71a07dfc-a3f1-4042-9748-7a0a82da7a81'} Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:07.044592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. Sep 11 00:08:07.046043 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:07.047323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Returning 404 to user: Instance 71a07dfc-a3f1-4042-9748-7a0a82da7a81 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:07.047323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a000928f-6c2c-4d48-89fd-05effe8fe613 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81" status: 404 len: 111 microversion: 2.1 time: 0.032908 Sep 11 00:08:07.047323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 398/799] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:07 2022] GET /compute/v2.1/servers/71a07dfc-a3f1-4042-9748-7a0a82da7a81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:08:07.549820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:07.550478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:07.557431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:07.557964 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:07.558397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:07.559158 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:07.559638 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:07.560052 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:07.804074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:07.812658 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-62b25f58-8586-4f5b-b9bd-27f145bd8b58 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.267093 Sep 11 00:08:07.813229 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 402/800] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:07 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:08.311096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:08.311591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:08.319393 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:08.319874 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:08.320310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:08.321005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:08.321456 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:08.321881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:08.337322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] HTTP exception thrown: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Request method failure captured: Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: DELETE /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 HTTP/1.1 Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVDz39WI8zSFD3sAxjj3AauZVU_YuIF61kZ9zSVTuvhSWeCR_4FJKf132MV4J6IpQlpIwvHoVlNnJhyEI1e7wpiNct6lt4c1TfyVx1bN2Gr_1RtrQHP1Qz08ttHxVn_uXjY45Jkz8-I6eAKw0vCLkrDy2z8MQ4SuqYY-aMRjURVXkQ Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:08:08.338902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_65f0209a8e48496c8d88c885f8364cbd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}] Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 9950f578162449c0845c3aa4aab692d4 Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.340476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '890c9ef2-f830-4f13-a0c4-53dfb10e08c0'} Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:08.341320 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.342740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.344143 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Returning 404 to user: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:08.344143 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1ee6d8ac-cbf0-46cc-b301-c08875346da2 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "DELETE /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 404 len: 111 microversion: 2.1 time: 0.033023 Sep 11 00:08:08.344143 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 399/801] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:08:08 2022] DELETE /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:08:08.348889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:08.349972 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] [instance: 890c9ef2-f830-4f13-a0c4-53dfb10e08c0] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:08.356379 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:08.356856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:08.357291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:08.357973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:08.358424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:08.358953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:08.373599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] HTTP exception thrown: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Request method failure captured: Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 HTTP/1.1 Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVDz39WI8zSFD3sAxjj3AauZVU_YuIF61kZ9zSVTuvhSWeCR_4FJKf132MV4J6IpQlpIwvHoVlNnJhyEI1e7wpiNct6lt4c1TfyVx1bN2Gr_1RtrQHP1Qz08ttHxVn_uXjY45Jkz8-I6eAKw0vCLkrDy2z8MQ4SuqYY-aMRjURVXkQ Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:08:08.375153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_65f0209a8e48496c8d88c885f8364cbd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/65f0209a8e48496c8d88c885f8364cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65f0209a8e48496c8d88c885f8364cbd"}]}] Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 65f0209a8e48496c8d88c885f8364cbd Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486723832 Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 9950f578162449c0845c3aa4aab692d4 Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeTestJSON-486723832-project Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.377108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '890c9ef2-f830-4f13-a0c4-53dfb10e08c0'} Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:08.377979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. Sep 11 00:08:08.379454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:08.382601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] Returning 404 to user: Instance 890c9ef2-f830-4f13-a0c4-53dfb10e08c0 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:08.382601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2720c48b-4e30-43cc-94f5-6a4d8ff8f0c4 tempest-AttachVolumeTestJSON-486723832 tempest-AttachVolumeTestJSON-486723832-project] 10.222.0.17 "GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0" status: 404 len: 111 microversion: 2.1 time: 0.031493 Sep 11 00:08:08.382601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 403/802] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:08 2022] GET /compute/v2.1/servers/890c9ef2-f830-4f13-a0c4-53dfb10e08c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:08:08.836365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:08.836982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:08.844292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:08.844292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:08.844609 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:08.845267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:08.845718 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:08.846139 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:08.851189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:09.011815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:09.021844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-29f43236-446e-47b2-8a14-7cd109d216de tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1756 microversion: 2.1 time: 0.189288 Sep 11 00:08:09.023260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 400/803] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:08 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:08:10.062966 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:10.063536 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:10.067335 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=4 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:10.071872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:10.072682 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:10.073195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:10.073986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:10.074516 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:10.075053 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:10.355239 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:10.360666 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d0520091-08f9-4afd-abf6-ee57d42e56bf tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1759 microversion: 2.1 time: 0.301632 Sep 11 00:08:10.361389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 404/804] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:10 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1759 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:19.863066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1746477477", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1175751162", "security_groups": [{"name": "tempest-secgroup-smoke-1684257562"}], "networks": [{"uuid": "8b5f6251-c831-4439-8e08-e5a6667ec93c"}], "block_device_mapping_v2": [{"uuid": "07f2efac-1c24-40cf-aaec-65d23d9125b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:19.875212 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:19.875862 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=4 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:19.996860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] validate_networks() for [('8b5f6251-c831-4439-8e08-e5a6667ec93c', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:08:20.510144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:08:20.510617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:08:20.511275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:08:20.511679 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:08:20.512085 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:08:20.524596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:20.524596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:20.524596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:20.527850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:20.527850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:20.527850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:20.542759 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Getting quotas for project 49b0d0136b404c68902274c0e571fb3a. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:08:20.546706 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Getting quotas for user 32b5ea2215fd4c38aabaf375db991d06 and project 49b0d0136b404c68902274c0e571fb3a. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:08:20.606419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:08:20.608753 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07f2efac-1c24-40cf-aaec-65d23d9125b1',volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:08:21.014607 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-12ee468a-22bc-4c9c-a42a-493a3ed363da tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.155277 Sep 11 00:08:21.015271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 401/805] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:08:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:08:21.026528 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-477e175a-adea-4a22-9d56-17ecf4317f6b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:21.029328 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-477e175a-adea-4a22-9d56-17ecf4317f6b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:21.029642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:21.030417 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=18 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:21.084073 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-477e175a-adea-4a22-9d56-17ecf4317f6b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:21.091703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-477e175a-adea-4a22-9d56-17ecf4317f6b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1089 microversion: 2.1 time: 0.068814 Sep 11 00:08:21.093614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 405/806] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:21 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:22.115256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:22.115796 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:22.122763 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:22.123202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:22.123636 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:22.124330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:22.124777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:22.125200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:22.191401 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:22.199701 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ccab435a-ddb7-438b-b08a-85b4e0c5750f tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1139 microversion: 2.1 time: 0.089053 Sep 11 00:08:22.200274 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 402/807] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:22 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:23.222785 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:23.223390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:23.231975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:23.232454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:23.232882 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:23.233571 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:23.237737 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:23.237737 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:23.324568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:23.333769 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-92d60a43-9f5a-4f2f-9dd9-77018454f9e5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1195 microversion: 2.1 time: 0.114804 Sep 11 00:08:23.334462 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 406/808] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:23 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1195 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:24.362175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:24.362175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:24.368978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:24.369653 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:24.370447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:24.375994 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:24.376892 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:24.377477 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:24.541912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:24.550151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-31fdb0f4-0bee-472e-81f9-adb600e9ee15 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1273 microversion: 2.1 time: 0.194535 Sep 11 00:08:24.551073 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 403/809] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:24 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:25.172034 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:25.174269 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:25.181396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.181933 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.182380 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.183104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.183631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.184058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.214298 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9a6849dc-f2ae-4c8c-b478-4e192ea45c98 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046216 Sep 11 00:08:25.214884 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 407/810] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Sep 11 00:08:25 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:25.275032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-29156d2d-aa7e-4efd-bd84-0947700a9bb1 req-229d247d-82f2-467c-9691-e7a750a5601c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902ccc1c-f002-4a8a-aa95-f84cea72606a", "tag": "b6f168ce-ddb7-4058-81ef-2684d1f44a39"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:25.281636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:25.282369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:25.287832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-29156d2d-aa7e-4efd-bd84-0947700a9bb1 req-229d247d-82f2-467c-9691-e7a750a5601c service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.288389 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-29156d2d-aa7e-4efd-bd84-0947700a9bb1 req-229d247d-82f2-467c-9691-e7a750a5601c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.289122 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.289474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-29156d2d-aa7e-4efd-bd84-0947700a9bb1 req-229d247d-82f2-467c-9691-e7a750a5601c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.289675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.290121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.290890 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.291348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.291774 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.305638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-29156d2d-aa7e-4efd-bd84-0947700a9bb1 req-229d247d-82f2-467c-9691-e7a750a5601c service nova] Creating event network-changed:b6f168ce-ddb7-4058-81ef-2684d1f44a39 for instance 902ccc1c-f002-4a8a-aa95-f84cea72606a on hv-cinder-85200 Sep 11 00:08:25.311726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-29156d2d-aa7e-4efd-bd84-0947700a9bb1 req-229d247d-82f2-467c-9691-e7a750a5601c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041654 Sep 11 00:08:25.312491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 404/811] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:08:25.321011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:08:25.575870 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:25.576562 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:25.583144 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.583623 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.584055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.584738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.585822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.586440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.594348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f459b3aa-bec0-4680-b8be-74fa4955aa68 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 204 len: 0 microversion: 2.20 time: 0.316617 Sep 11 00:08:25.597241 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 408/812] 10.222.0.17 () {60 vars in 1280 bytes} [Sun Sep 11 00:08:25 2022] DELETE /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 11 00:08:25.603702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:25.604392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:25.612439 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.613772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.615122 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.615885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:25.616977 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:25.617842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:25.736376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:25.744818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-87956cba-ac63-49c7-9755-11870d4ab33d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.173957 Sep 11 00:08:25.745471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 405/813] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:25 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:08:25.753317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:25.761540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:25.763010 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:25.764179 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a320fe06-a3f7-40cc-a665-cd33108822d3 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.164885 Sep 11 00:08:25.764741 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 409/814] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:08:25 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:08:26.768233 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:26.768880 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:26.776132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:26.776610 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:26.777036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:26.777717 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:26.778159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:26.778611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:26.791161 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:26.791797 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:26.798453 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:26.798970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:26.799401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:26.800096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:26.800607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:26.801032 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:26.915755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:26.924599 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a472f998-f242-4dba-93d6-1d8cc3c04bc8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.160225 Sep 11 00:08:26.925178 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 406/815] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:26 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:26.968522 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:26.977310 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:26.978756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:26.979906 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2ca8fa08-6171-479e-842e-b0099f13889b tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1721 microversion: 2.20 time: 0.193066 Sep 11 00:08:26.980456 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 410/816] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:08:26 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:08:27.947813 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:27.948458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:27.955836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:27.956326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:27.958834 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:27.959576 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:27.960789 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:27.961109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:28.015870 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:28.016904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:28.026243 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:28.026761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:28.027189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:28.027887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:28.028328 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:28.028742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:28.134260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:28.135407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:28.145088 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:28.146224 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4341dca4-cd0f-4a31-b3b2-c678bad7ca6a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.202477 Sep 11 00:08:28.147065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 407/817] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:27 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:28.165801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:28.167200 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-901f4d05-2553-4bee-8d5e-9ac1a6b2f3b5 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1653 microversion: 2.20 time: 0.157351 Sep 11 00:08:28.167794 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 411/818] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:08:28 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1653 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:08:28.453595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-ed445d89-3e71-4e04-9e4c-995edd93f2e1 req-76bc12c7-1e61-400a-b4a5-ce400160b53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede54ea4-13f8-4bf2-bba7-8291c078c1c8", "name": "network-vif-deleted", "tag": "3a2fb6f5-4c77-4613-a8e9-31df96539e3d"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:28.467103 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ed445d89-3e71-4e04-9e4c-995edd93f2e1 req-76bc12c7-1e61-400a-b4a5-ce400160b53d service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:28.467729 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ed445d89-3e71-4e04-9e4c-995edd93f2e1 req-76bc12c7-1e61-400a-b4a5-ce400160b53d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:28.468396 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ed445d89-3e71-4e04-9e4c-995edd93f2e1 req-76bc12c7-1e61-400a-b4a5-ce400160b53d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:28.487184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-ed445d89-3e71-4e04-9e4c-995edd93f2e1 req-76bc12c7-1e61-400a-b4a5-ce400160b53d service nova] Creating event network-vif-deleted:3a2fb6f5-4c77-4613-a8e9-31df96539e3d for instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 on hv-cinder-85200 Sep 11 00:08:28.493293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-ed445d89-3e71-4e04-9e4c-995edd93f2e1 req-76bc12c7-1e61-400a-b4a5-ce400160b53d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043435 Sep 11 00:08:28.494077 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 408/819] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:08:29.173418 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:29.174187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:29.182818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:29.183308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:29.183743 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:29.184471 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:29.184920 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:29.185335 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:29.198966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:29.200462 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:29.209736 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:29.211070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:29.211771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:29.215153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:29.215153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:29.215153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:29.259322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:29.260211 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:29.260877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:29.262002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lazy-loading 'fault' on Instance uuid ede54ea4-13f8-4bf2-bba7-8291c078c1c8 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:08:29.325083 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:29.335975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:29.338007 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a66188ce11bc403d9c657efd78f3019a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3ed6ff48b44385acef77c00e631b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:29.339194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bfdcb426-e6a5-4d43-876e-f0f41c3ca8dc tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 200 len: 1370 microversion: 2.20 time: 0.146100 Sep 11 00:08:29.340330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 409/820] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:08:29 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:08:29.368873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:29.376531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-20ca9104-68d3-46b3-922b-c805e27983c3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.207794 Sep 11 00:08:29.377505 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 412/821] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:29 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:30.364951 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:30.365584 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:30.372835 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:30.373309 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:30.373742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:30.374433 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:30.374919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:30.379391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:30.388811 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] HTTP exception thrown: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Request method failure captured: Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 HTTP/1.1 Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVHlua8t6Ni2REZ1FvZtYnnRm5tvuK-y-0C9IjKrZMk7lq6wz9ZZUSrELXLDPA9ItdXt4Y3br-Ovhh6snmEGufsWjRpYmcmnsp3itd-kdQV8PQUyBAKTrqM7kMLbqA0PDBkJfCHK6VjM4Nt72d5HSZjREDOhZvC-SnZ7Kje4jsVffg Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:08:30.390445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c3ed6ff48b44385acef77c00e631b6e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}] Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: a66188ce11bc403d9c657efd78f3019a Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:30.392181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'ede54ea4-13f8-4bf2-bba7-8291c078c1c8'} Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:30.393046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:30.394675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:30.396135 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Returning 404 to user: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:30.396135 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fec218b5-3e1e-4239-9c20-a246ad3e7cf7 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 404 len: 111 microversion: 2.20 time: 0.031050 Sep 11 00:08:30.396135 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 410/822] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:08:30 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:08:30.401034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ffd9ae3c-6389-447f-b91f-21fa5c1b4abb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '.version_select at 0x7f5ab668b790>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:30.401228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:30.401989 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:30.408557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:30.409449 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:30.409708 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:30.410514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:30.411102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:30.411597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:30.486425 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ffd9ae3c-6389-447f-b91f-21fa5c1b4abb tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46702388" status: 204 len: 0 microversion: 2.20 time: 0.089481 Sep 11 00:08:30.487153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 411/823] 10.222.0.17 () {60 vars in 1256 bytes} [Sun Sep 11 00:08:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46702388 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 11 00:08:30.563390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:30.571941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c3669cac-9dce-4541-b118-925debaeebb9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.175529 Sep 11 00:08:30.572665 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 413/824] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:30 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:31.593220 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:31.594045 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=6 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:31.598583 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:31.599225 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:31.606866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:31.607350 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:31.607785 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:31.608480 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:31.608924 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:31.609345 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:31.744777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:31.752389 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-aed6703e-eb27-49b7-b389-72ae84d7b231 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.160139 Sep 11 00:08:31.752948 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 412/825] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:31 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:32.541981 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:32.542466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:32.544500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:32.549703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:32.550187 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:32.550619 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:32.551399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:32.551852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:32.552277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:32.566104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] HTTP exception thrown: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Request method failure captured: Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 HTTP/1.1 Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVHlua8t6Ni2REZ1FvZtYnnRm5tvuK-y-0C9IjKrZMk7lq6wz9ZZUSrELXLDPA9ItdXt4Y3br-Ovhh6snmEGufsWjRpYmcmnsp3itd-kdQV8PQUyBAKTrqM7kMLbqA0PDBkJfCHK6VjM4Nt72d5HSZjREDOhZvC-SnZ7Kje4jsVffg Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:08:32.567772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c3ed6ff48b44385acef77c00e631b6e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}] Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: a66188ce11bc403d9c657efd78f3019a Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.569993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'ede54ea4-13f8-4bf2-bba7-8291c078c1c8'} Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:32.571155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.573081 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.574786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Returning 404 to user: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:32.574786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1fc5fe48-ebff-4eae-a52a-e332609e27ca tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 404 len: 111 microversion: 2.20 time: 0.031215 Sep 11 00:08:32.574786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 414/826] 10.222.0.17 () {60 vars in 1280 bytes} [Sun Sep 11 00:08:32 2022] DELETE /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:08:32.579219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:32.579822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: ede54ea4-13f8-4bf2-bba7-8291c078c1c8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:32.589920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:32.590410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:32.591014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:32.591809 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:32.592267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:32.592697 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:32.607337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] HTTP exception thrown: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Request method failure captured: Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 HTTP/1.1 Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVHlua8t6Ni2REZ1FvZtYnnRm5tvuK-y-0C9IjKrZMk7lq6wz9ZZUSrELXLDPA9ItdXt4Y3br-Ovhh6snmEGufsWjRpYmcmnsp3itd-kdQV8PQUyBAKTrqM7kMLbqA0PDBkJfCHK6VjM4Nt72d5HSZjREDOhZvC-SnZ7Kje4jsVffg Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:08:32.608912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c3ed6ff48b44385acef77c00e631b6e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}] Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: a66188ce11bc403d9c657efd78f3019a Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.610518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'ede54ea4-13f8-4bf2-bba7-8291c078c1c8'} Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:32.611589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. Sep 11 00:08:32.613015 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:32.614417 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Returning 404 to user: Instance ede54ea4-13f8-4bf2-bba7-8291c078c1c8 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:32.614417 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c351d316-505f-4a6b-a86b-90a6896b8d13 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8" status: 404 len: 111 microversion: 2.20 time: 0.035648 Sep 11 00:08:32.614417 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 413/827] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:08:32 2022] GET /compute/v2.1/servers/ede54ea4-13f8-4bf2-bba7-8291c078c1c8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:08:32.778893 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:32.779515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:32.785755 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:32.786244 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:32.786702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:32.787401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:32.787855 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:32.788302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:32.933298 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:32.941017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-dc50970d-b08c-4e9a-94b0-23d13104802e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.166403 Sep 11 00:08:32.941581 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 415/828] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:32 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:08:33.877119 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:33.877625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:33.884150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:33.884638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:33.885074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:33.885859 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:33.886326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:33.886626 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:33.900448 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] HTTP exception thrown: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Request method failure captured: Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: DELETE /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 HTTP/1.1 Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSVHlua8t6Ni2REZ1FvZtYnnRm5tvuK-y-0C9IjKrZMk7lq6wz9ZZUSrELXLDPA9ItdXt4Y3br-Ovhh6snmEGufsWjRpYmcmnsp3itd-kdQV8PQUyBAKTrqM7kMLbqA0PDBkJfCHK6VjM4Nt72d5HSZjREDOhZvC-SnZ7Kje4jsVffg Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:08:33.901997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c3ed6ff48b44385acef77c00e631b6e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}] Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: a66188ce11bc403d9c657efd78f3019a Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.903627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'b206b090-4c06-4bf1-a005-379f4056da27'} Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:33.904486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.905921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.907955 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Returning 404 to user: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:33.907955 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-746d45e1-3d88-4212-82c4-840e0ab29955 tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 404 len: 111 microversion: 2.20 time: 0.030187 Sep 11 00:08:33.907955 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 414/829] 10.222.0.17 () {60 vars in 1280 bytes} [Sun Sep 11 00:08:33 2022] DELETE /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:08:33.912598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:33.913921 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] [instance: b206b090-4c06-4bf1-a005-379f4056da27] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:33.920776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:33.921324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:33.921819 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:33.922649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:33.923190 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:33.923820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:33.937184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] HTTP exception thrown: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Request method failure captured: Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 HTTP/1.1 Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSVHlua8t6Ni2REZ1FvZtYnnRm5tvuK-y-0C9IjKrZMk7lq6wz9ZZUSrELXLDPA9ItdXt4Y3br-Ovhh6snmEGufsWjRpYmcmnsp3itd-kdQV8PQUyBAKTrqM7kMLbqA0PDBkJfCHK6VjM4Nt72d5HSZjREDOhZvC-SnZ7Kje4jsVffg Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:08:33.938736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c3ed6ff48b44385acef77c00e631b6e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c3ed6ff48b44385acef77c00e631b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c3ed6ff48b44385acef77c00e631b6e"}]}] Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 1c3ed6ff48b44385acef77c00e631b6e Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490945301 Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: a66188ce11bc403d9c657efd78f3019a Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490945301-project Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.940354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'b206b090-4c06-4bf1-a005-379f4056da27'} Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:33.941150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. Sep 11 00:08:33.942324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:08:33.943427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] Returning 404 to user: Instance b206b090-4c06-4bf1-a005-379f4056da27 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:33.943427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-49d7905e-0992-4923-86e7-c701c2e6e27d tempest-AttachVolumeShelveTestJSON-1490945301 tempest-AttachVolumeShelveTestJSON-1490945301-project] 10.222.0.17 "GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27" status: 404 len: 111 microversion: 2.20 time: 0.031414 Sep 11 00:08:33.943427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 416/830] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Sep 11 00:08:33 2022] GET /compute/v2.1/servers/b206b090-4c06-4bf1-a005-379f4056da27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 11 00:08:33.965192 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:33.965799 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:33.971977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:33.972484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:33.972917 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:33.973588 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:33.974041 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:33.974467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:34.108716 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:34.116450 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-77a7d1de-f97c-4687-ad43-e05cfc9129c4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.155049 Sep 11 00:08:34.117023 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 415/831] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:33 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:35.139657 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:35.141161 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:35.149232 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:35.149816 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:35.150323 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:35.151158 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:35.151682 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:35.152224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:35.357801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:35.366750 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3041f296-d129-4c13-8f91-c19110c99539 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.230570 Sep 11 00:08:35.377746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 417/832] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:35 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:36.391495 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:36.392106 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:36.398390 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:36.398923 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:36.399353 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:36.400155 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:36.400641 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:36.401017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:36.560942 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:36.569969 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4b82f0db-be65-4024-8be5-7ae9961332f4 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.182598 Sep 11 00:08:36.571262 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 416/833] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:36 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:37.449407 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-6c854bdd-a9f5-4dfa-8a1d-6c046a099b6b req-5a492f1e-8ae7-441b-88eb-02863fe23c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902ccc1c-f002-4a8a-aa95-f84cea72606a", "name": "network-vif-plugged", "status": "completed", "tag": "b6f168ce-ddb7-4058-81ef-2684d1f44a39"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:37.459833 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6c854bdd-a9f5-4dfa-8a1d-6c046a099b6b req-5a492f1e-8ae7-441b-88eb-02863fe23c51 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:37.460488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6c854bdd-a9f5-4dfa-8a1d-6c046a099b6b req-5a492f1e-8ae7-441b-88eb-02863fe23c51 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:37.461221 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-6c854bdd-a9f5-4dfa-8a1d-6c046a099b6b req-5a492f1e-8ae7-441b-88eb-02863fe23c51 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:37.474611 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-6c854bdd-a9f5-4dfa-8a1d-6c046a099b6b req-5a492f1e-8ae7-441b-88eb-02863fe23c51 service nova] Creating event network-vif-plugged:b6f168ce-ddb7-4058-81ef-2684d1f44a39 for instance 902ccc1c-f002-4a8a-aa95-f84cea72606a on hv-cinder-85200 Sep 11 00:08:37.496855 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-6c854bdd-a9f5-4dfa-8a1d-6c046a099b6b req-5a492f1e-8ae7-441b-88eb-02863fe23c51 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053557 Sep 11 00:08:37.498561 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 418/834] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:08:37.597607 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:37.598214 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:37.614419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:37.617289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:37.617289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:37.617289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:37.617289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:37.617657 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:37.897277 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:37.905915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b9db4d3d-98f0-4632-b326-21b875f11652 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.312041 Sep 11 00:08:37.906785 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 417/835] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:37 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:38.931506 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:38.932318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:38.939032 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:38.939614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:38.940184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:38.940881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:38.941331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:38.941751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:39.084119 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:39.092492 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-22e595ff-6343-4f35-a81c-19d4b2fa2d49 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1261 microversion: 2.1 time: 0.166481 Sep 11 00:08:39.093050 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 419/836] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:38 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:40.116688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:40.118356 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:40.125958 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:40.126460 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:40.126917 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:40.127614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:40.128055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:40.128724 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:40.283734 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:40.292387 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-74acfc2d-e3e4-4700-b58d-cb8d2735e061 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1446 microversion: 2.1 time: 0.180473 Sep 11 00:08:40.293201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 418/837] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:40 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1446 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:40.315531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:40.316135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:40.323461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:40.324669 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:40.325106 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:40.325801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:40.326505 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:40.327012 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:40.473883 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:40.482361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-48c53fe5-5e43-49ae-93c2-58baacc03f32 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1446 microversion: 2.1 time: 0.170718 Sep 11 00:08:40.483037 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 420/838] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:40 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:43.279653 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-907b002f-edc9-4647-b52f-38dbc35635f8 req-f5257d1b-de9d-4589-bf94-6231e6419268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902ccc1c-f002-4a8a-aa95-f84cea72606a", "tag": "b6f168ce-ddb7-4058-81ef-2684d1f44a39"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:43.313735 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-907b002f-edc9-4647-b52f-38dbc35635f8 req-f5257d1b-de9d-4589-bf94-6231e6419268 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:43.314283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-907b002f-edc9-4647-b52f-38dbc35635f8 req-f5257d1b-de9d-4589-bf94-6231e6419268 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:43.315036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-907b002f-edc9-4647-b52f-38dbc35635f8 req-f5257d1b-de9d-4589-bf94-6231e6419268 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:43.331041 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-907b002f-edc9-4647-b52f-38dbc35635f8 req-f5257d1b-de9d-4589-bf94-6231e6419268 service nova] Creating event network-changed:b6f168ce-ddb7-4058-81ef-2684d1f44a39 for instance 902ccc1c-f002-4a8a-aa95-f84cea72606a on hv-cinder-85200 Sep 11 00:08:43.338328 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-907b002f-edc9-4647-b52f-38dbc35635f8 req-f5257d1b-de9d-4589-bf94-6231e6419268 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062299 Sep 11 00:08:43.339500 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 419/839] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:08:46.509760 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-adfd92e9-09fd-422b-b686-ab8c89a687aa tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: .version_select at 0x7f5ab66ba160>, body: {"keypair": {"name": "tempest-keypair-1763496671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWsJDUDx6b7qOK7FSomhwKfJWoLa+If2ASpwPWpxnG5Df52AMCm/Bq/svTQntsvkMjee/hUodq9Xa6DRk3/XkO/dg/6uzjLHI2S8MthuOZyWTwJCyqajLtuw/P+M7dX6A=="}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:46.526024 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-adfd92e9-09fd-422b-b686-ab8c89a687aa tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:08:46.530147 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-adfd92e9-09fd-422b-b686-ab8c89a687aa tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for user 6ae921c806734b0a8218ea7453e8bd4e and project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'key_pairs'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:08:46.607982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-adfd92e9-09fd-422b-b686-ab8c89a687aa tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.224045 Sep 11 00:08:46.608620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 421/840] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:08:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:08:49.155209 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1623628319", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "703dcb23-f6c5-48ec-90e6-3c57db88c851"}], "security_groups": [{"name": "tempest-securitygroup--1695127481"}], "key_name": "tempest-keypair-1763496671", "user_data": "}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:49.268503 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] validate_networks() for [('703dcb23-f6c5-48ec-90e6-3c57db88c851', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:08:49.676650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:08:49.677266 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:08:49.677801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:08:49.678272 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:08:49.678844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:08:49.690643 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:49.691276 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:49.691726 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:49.692441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:49.692882 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:49.693473 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:49.713428 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:08:49.717895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for user 6ae921c806734b0a8218ea7453e8bd4e and project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:08:49.729477 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:08:49.732477 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:08:49.855234 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e7d66fd1-65a0-48a9-a463-f9faddeddf6a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712269 Sep 11 00:08:49.855899 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 420/841] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:08:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:08:49.868776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cb64f30a-bee9-41a1-8f26-76baa0f1c4c4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:49.873091 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cb64f30a-bee9-41a1-8f26-76baa0f1c4c4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:49.889347 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-636527872"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:49.890384 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:49.902540 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:49.903078 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:49.903517 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:49.913409 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:49.913409 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:49.913409 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:49.948830 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cb64f30a-bee9-41a1-8f26-76baa0f1c4c4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:49.964448 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cb64f30a-bee9-41a1-8f26-76baa0f1c4c4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1242 microversion: 2.1 time: 0.101083 Sep 11 00:08:49.965398 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 422/842] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:49 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:50.081982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.network.security_group_api [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Removing security group cccf3aaa-0dc0-4a9e-972b-db00a3127a9a from port e95bb83f-e43c-448b-9195-7dc5592a9c51 Sep 11 00:08:50.512184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f2083424-2e29-4397-a746-4e9ebd0d90ad tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "POST /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/action" status: 202 len: 0 microversion: 2.1 time: 0.627338 Sep 11 00:08:50.515999 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 421/843] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:08:49 2022] POST /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:08:50.521904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-2515891b-9015-4fa3-8373-80c1a4a5437e req-3417b83f-564f-4960-afc9-3d1fe8aaa29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7275256b-8e7b-4327-924b-fdde977cb722", "tag": "e95bb83f-e43c-448b-9195-7dc5592a9c51"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:50.529218 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:50.534715 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-2515891b-9015-4fa3-8373-80c1a4a5437e req-3417b83f-564f-4960-afc9-3d1fe8aaa29a service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:50.535584 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-2515891b-9015-4fa3-8373-80c1a4a5437e req-3417b83f-564f-4960-afc9-3d1fe8aaa29a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:50.546615 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-2515891b-9015-4fa3-8373-80c1a4a5437e req-3417b83f-564f-4960-afc9-3d1fe8aaa29a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:50.549812 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-2515891b-9015-4fa3-8373-80c1a4a5437e req-3417b83f-564f-4960-afc9-3d1fe8aaa29a service nova] Creating event network-changed:e95bb83f-e43c-448b-9195-7dc5592a9c51 for instance 7275256b-8e7b-4327-924b-fdde977cb722 on hv-cinder-85200 Sep 11 00:08:50.556459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-2515891b-9015-4fa3-8373-80c1a4a5437e req-3417b83f-564f-4960-afc9-3d1fe8aaa29a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038325 Sep 11 00:08:50.557343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 423/844] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:08:50.995369 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:50.996365 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:50.998741 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:51.006194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:51.007463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:51.011467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:51.011467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:51.011467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:51.011467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:51.012738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=89 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:51.119472 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:51.129789 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7c8fe952-a01d-4eb8-b979-62406c564397 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1246 microversion: 2.1 time: 0.140996 Sep 11 00:08:51.130382 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 422/845] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:50 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:52.156637 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:52.157362 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:52.172740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:52.172740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:52.172740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:52.172740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:52.173130 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:52.173130 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:52.200252 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:52.200787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:52.209079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:52.209566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:52.210639 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:52.211375 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:52.218801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:52.219452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:52.244133 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:52.257306 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6bb87582-1bfc-4c6f-955a-7aaa08204ce9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1294 microversion: 2.1 time: 0.106469 Sep 11 00:08:52.258283 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 424/846] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:52 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:52.338595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lazy-loading 'services' on Instance uuid 7275256b-8e7b-4327-924b-fdde977cb722 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:08:52.537025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1c654c8f-7ede-4ce2-9dbe-f637124ceef2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments/c500721f-b554-4640-a19c-f8a676d17389" status: 202 len: 0 microversion: 2.1 time: 0.340963 Sep 11 00:08:52.538586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 423/847] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:08:52 2022] DELETE /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments/c500721f-b554-4640-a19c-f8a676d17389 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:08:52.547975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:52.550693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:52.558277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:52.559080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:52.559621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:52.560402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:52.560858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:52.561285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:52.584263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-949f23e0-e5cb-4526-8539-e1ae700f4a79 req-c09e83e5-c4ed-4f0e-abeb-d3f9959e82f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7275256b-8e7b-4327-924b-fdde977cb722", "tag": "e95bb83f-e43c-448b-9195-7dc5592a9c51"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:52.596195 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-949f23e0-e5cb-4526-8539-e1ae700f4a79 req-c09e83e5-c4ed-4f0e-abeb-d3f9959e82f0 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:52.596951 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-949f23e0-e5cb-4526-8539-e1ae700f4a79 req-c09e83e5-c4ed-4f0e-abeb-d3f9959e82f0 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:52.597562 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-949f23e0-e5cb-4526-8539-e1ae700f4a79 req-c09e83e5-c4ed-4f0e-abeb-d3f9959e82f0 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:52.610130 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-949f23e0-e5cb-4526-8539-e1ae700f4a79 req-c09e83e5-c4ed-4f0e-abeb-d3f9959e82f0 service nova] Creating event network-changed:e95bb83f-e43c-448b-9195-7dc5592a9c51 for instance 7275256b-8e7b-4327-924b-fdde977cb722 on hv-cinder-85200 Sep 11 00:08:52.615463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-949f23e0-e5cb-4526-8539-e1ae700f4a79 req-c09e83e5-c4ed-4f0e-abeb-d3f9959e82f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041309 Sep 11 00:08:52.616754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 424/848] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:08:52.635172 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-deac4c73-0b2a-4a3c-86c5-6f6ee3c6f8e5 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091961 Sep 11 00:08:52.635850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 425/849] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:08:52 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:08:53.283629 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:53.284419 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:53.291386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:53.291877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:53.292319 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:53.293027 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:53.293480 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:53.293949 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:53.378110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:53.388405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0d384c90-0f6e-4d54-9682-75b8e5fe2823 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1300 microversion: 2.1 time: 0.109396 Sep 11 00:08:53.389436 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 425/850] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:53 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:53.651403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:53.653566 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:53.661178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:53.661658 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:53.662090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:53.662877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:53.664118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:53.664542 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:53.697251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bdec24c0-a361-4538-8a47-ca86431683b2 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052171 Sep 11 00:08:53.698064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 426/851] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:08:53 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:08:54.413872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:54.414497 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:54.420782 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:54.421258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:54.424611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:54.424611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:54.424611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:54.424611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:54.583727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:54.593059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-767fac7c-26ad-4ff7-aa75-928646e07f66 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1368 microversion: 2.1 time: 0.183899 Sep 11 00:08:54.593628 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 426/852] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:54 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:54.712792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:54.715017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:54.721410 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:54.721890 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:54.722321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:54.723038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:54.723488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:54.723907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:54.754109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3b568595-f531-40f0-8e85-55df82a26e7c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048105 Sep 11 00:08:54.754700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 427/853] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:08:54 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:08:54.765459 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:54.765952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:54.771918 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:54.772643 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:54.773087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:54.773783 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:54.774361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:54.774830 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:54.840194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-a9a7cfe6-fa4e-4695-b8e4-43d1ea42515f req-f0cfcc40-18d0-4cd1-a687-eaa3fdd9752c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6945de1c-cdb3-4dd1-bc79-cd8d617396ee", "tag": "f97b3ac5-1d1c-4668-b665-d7b116ff85c0"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:54.851839 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-a9a7cfe6-fa4e-4695-b8e4-43d1ea42515f req-f0cfcc40-18d0-4cd1-a687-eaa3fdd9752c service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:54.852615 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-a9a7cfe6-fa4e-4695-b8e4-43d1ea42515f req-f0cfcc40-18d0-4cd1-a687-eaa3fdd9752c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:54.853762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-a9a7cfe6-fa4e-4695-b8e4-43d1ea42515f req-f0cfcc40-18d0-4cd1-a687-eaa3fdd9752c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:54.868042 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] HTTP exception thrown: Instance 7275256b-8e7b-4327-924b-fdde977cb722 is not attached to volume c500721f-b554-4640-a19c-f8a676d17389 Sep 11 00:08:54.870777 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-a9a7cfe6-fa4e-4695-b8e4-43d1ea42515f req-f0cfcc40-18d0-4cd1-a687-eaa3fdd9752c service nova] Creating event network-changed:f97b3ac5-1d1c-4668-b665-d7b116ff85c0 for instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee on hv-cinder-85200 Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Request method failure captured: Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: DELETE /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments/c500721f-b554-4640-a19c-f8a676d17389 HTTP/1.1 Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSZ9KEotV-xgXls04M_spmQkPHQyft3zNrptsAJGoer8B9a4YO2B2vhXij-PRPN8joum2wDJMAc7DIqYVijle3sUJ5sfQpjziTHjiLmHffCeUyVVBEmhQBGlVu6DEd9WSsJ3nMCWLSmqrosrbbjr1uNie5CngSZ9AcnoU1rE4vlW5mc Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 82b6b05c598d44ee8b8748b6bab1f9e5 Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-TestMinimumBasicScenario-678984429 Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:08:54.871876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_82b6b05c598d44ee8b8748b6bab1f9e5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82b6b05c598d44ee8b8748b6bab1f9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/82b6b05c598d44ee8b8748b6bab1f9e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82b6b05c598d44ee8b8748b6bab1f9e5"}]}] Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-TestMinimumBasicScenario-678984429 Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 82b6b05c598d44ee8b8748b6bab1f9e5 Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-TestMinimumBasicScenario-678984429 Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-TestMinimumBasicScenario-678984429-project Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: fd106d45a1ce4aad9c85c35d4f53af92 Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-TestMinimumBasicScenario-678984429-project Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:08:54.873271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 7275256b-8e7b-4327-924b-fdde977cb722 is not attached to volume c500721f-b554-4640-a19c-f8a676d17389 Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'server_id': '7275256b-8e7b-4327-924b-fdde977cb722', 'id': 'c500721f-b554-4640-a19c-f8a676d17389'} Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c500721f-b554-4640-a19c-f8a676d17389. Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:08:54.873979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7275256b-8e7b-4327-924b-fdde977cb722 is not attached to volume c500721f-b554-4640-a19c-f8a676d17389 Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7275256b-8e7b-4327-924b-fdde977cb722 is not attached to volume c500721f-b554-4640-a19c-f8a676d17389 Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:08:54.875981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Returning 404 to user: Instance 7275256b-8e7b-4327-924b-fdde977cb722 is not attached to volume c500721f-b554-4640-a19c-f8a676d17389 {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:08:54.877619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-88fd4282-ac26-4134-b0a8-d5e907fb4374 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments/c500721f-b554-4640-a19c-f8a676d17389" status: 404 len: 154 microversion: 2.1 time: 0.111894 Sep 11 00:08:54.877619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 427/854] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:08:54 2022] DELETE /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722/os-volume_attachments/c500721f-b554-4640-a19c-f8a676d17389 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:08:54.879017 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-a9a7cfe6-fa4e-4695-b8e4-43d1ea42515f req-f0cfcc40-18d0-4cd1-a687-eaa3fdd9752c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042994 Sep 11 00:08:54.879744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 428/855] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:08:55.624767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:55.625414 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:55.634266 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:55.635177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:55.635866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:55.636676 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:55.637232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:55.638410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:55.776086 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:55.784140 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ef6dc93e-118d-4aee-98b5-1b4d67055739 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1368 microversion: 2.1 time: 0.163989 Sep 11 00:08:55.784687 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 428/856] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:55 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:56.167320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:56.167897 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:56.169869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:08:56.174676 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:56.175161 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:56.175594 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:56.176302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:56.176753 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:56.177172 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:56.202805 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:08:56.514233 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c3646f17-bf61-43d7-a291-9fc54b3239c7 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 204 len: 0 microversion: 2.1 time: 0.351430 Sep 11 00:08:56.514841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 429/857] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:08:56 2022] DELETE /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:08:56.523850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:56.524460 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:56.530455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:56.530981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:56.531394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:56.532117 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:56.532559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:56.532972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:56.673715 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:56.682143 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ca73c2e1-c3aa-4c46-b4e1-29009395bc9d tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1554 microversion: 2.1 time: 0.162969 Sep 11 00:08:56.682763 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 429/858] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:56 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:56.808320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:56.809009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:56.815060 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:56.815761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:56.816514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:56.817477 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:56.818055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:56.818710 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:56.963026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:56.970579 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f50478f3-b04f-4b7b-9381-2013d38866a3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1368 microversion: 2.1 time: 0.167517 Sep 11 00:08:56.971167 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 430/859] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:56 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:57.705787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:57.706415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:57.713548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:57.714036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:57.714473 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:57.715198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:57.715652 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:57.716076 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:57.847542 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:57.855328 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-322b0097-c69b-4728-8bf5-ab50530b4e9c tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1554 microversion: 2.1 time: 0.153316 Sep 11 00:08:57.855903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 430/860] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:57 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:57.993097 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:57.994998 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:58.001167 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:58.001656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:58.002096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:58.002834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:58.003345 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:58.003769 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:58.136302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:58.144172 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2818f4ec-d57b-4441-9f95-bbebab5e82b8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1368 microversion: 2.1 time: 0.155083 Sep 11 00:08:58.150231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 431/861] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:57 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:58.882271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:58.882857 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:58.888792 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:58.889277 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:58.889720 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:58.890409 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:58.890896 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:58.891322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:59.029748 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:59.038146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5571bcc3-791d-45e6-af63-f829a704e7e6 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1554 microversion: 2.1 time: 0.160224 Sep 11 00:08:59.039013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 431/862] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:58 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:08:59.168486 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:08:59.169717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:08:59.176094 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:59.177021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:59.177021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:59.177707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:59.178161 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:59.179166 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:59.373538 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:08:59.381231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9bde2598-76f5-45b1-8e2e-ade22ba00ec1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1368 microversion: 2.1 time: 0.216701 Sep 11 00:08:59.385515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 432/863] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:08:59 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:08:59.524139 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-1f228b1a-bd7f-4cc2-ba47-1dd8f198d3c9 req-779da708-8a89-4993-86fb-334449135802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6945de1c-cdb3-4dd1-bc79-cd8d617396ee", "name": "network-vif-plugged", "status": "completed", "tag": "f97b3ac5-1d1c-4668-b665-d7b116ff85c0"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:59.536733 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-1f228b1a-bd7f-4cc2-ba47-1dd8f198d3c9 req-779da708-8a89-4993-86fb-334449135802 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:59.537284 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-1f228b1a-bd7f-4cc2-ba47-1dd8f198d3c9 req-779da708-8a89-4993-86fb-334449135802 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:59.538335 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-1f228b1a-bd7f-4cc2-ba47-1dd8f198d3c9 req-779da708-8a89-4993-86fb-334449135802 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:59.550196 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-1f228b1a-bd7f-4cc2-ba47-1dd8f198d3c9 req-779da708-8a89-4993-86fb-334449135802 service nova] Creating event network-vif-plugged:f97b3ac5-1d1c-4668-b665-d7b116ff85c0 for instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee on hv-cinder-85200 Sep 11 00:08:59.556146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-1f228b1a-bd7f-4cc2-ba47-1dd8f198d3c9 req-779da708-8a89-4993-86fb-334449135802 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041416 Sep 11 00:08:59.556967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 432/864] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:08:59.571384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-789b4f67-c6aa-4fed-af33-e3a06bcde6e6 req-b3650b23-685e-4317-9b5e-aef319cbad12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7275256b-8e7b-4327-924b-fdde977cb722", "name": "network-vif-deleted", "tag": "e95bb83f-e43c-448b-9195-7dc5592a9c51"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:08:59.581838 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-789b4f67-c6aa-4fed-af33-e3a06bcde6e6 req-b3650b23-685e-4317-9b5e-aef319cbad12 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:08:59.582313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-789b4f67-c6aa-4fed-af33-e3a06bcde6e6 req-b3650b23-685e-4317-9b5e-aef319cbad12 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:08:59.582761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-789b4f67-c6aa-4fed-af33-e3a06bcde6e6 req-b3650b23-685e-4317-9b5e-aef319cbad12 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:08:59.596428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-789b4f67-c6aa-4fed-af33-e3a06bcde6e6 req-b3650b23-685e-4317-9b5e-aef319cbad12 service nova] Creating event network-vif-deleted:e95bb83f-e43c-448b-9195-7dc5592a9c51 for instance 7275256b-8e7b-4327-924b-fdde977cb722 on hv-cinder-85200 Sep 11 00:08:59.602883 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-789b4f67-c6aa-4fed-af33-e3a06bcde6e6 req-b3650b23-685e-4317-9b5e-aef319cbad12 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035524 Sep 11 00:08:59.603505 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 433/865] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:09:00.058834 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:00.059610 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=6 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:00.064129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:00.064828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:00.071691 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:00.072178 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:00.072617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:00.073305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:00.073755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:00.074183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:00.109984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:00.110378 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:00.110847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:00.111293 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lazy-loading 'fault' on Instance uuid 7275256b-8e7b-4327-924b-fdde977cb722 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:09:00.155946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:00.164253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d45ea48c-67a5-4b14-86ba-8daeb4cb2221 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1349 microversion: 2.1 time: 0.106405 Sep 11 00:09:00.164822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 433/866] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:00 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:00.405186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:00.405882 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:00.409043 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=6 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:00.413891 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:00.414375 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:00.414839 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:00.415621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:00.416073 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:00.416585 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:00.549696 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:00.558127 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2d8356c4-cbab-42a5-8914-5c3d0b5d33fe tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1368 microversion: 2.1 time: 0.157101 Sep 11 00:09:00.558705 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 434/867] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:00 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:01.187902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:01.188519 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:01.194915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:01.195395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:01.195833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:01.196515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:01.197004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:01.197427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:01.230532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:01.231028 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:01.231459 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:01.231890 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lazy-loading 'fault' on Instance uuid 7275256b-8e7b-4327-924b-fdde977cb722 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:09:01.274209 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd106d45a1ce4aad9c85c35d4f53af92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6b05c598d44ee8b8748b6bab1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:01.281901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fc171308-dfeb-4ad9-81d8-a96943fa6fd3 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 200 len: 1349 microversion: 2.1 time: 0.097922 Sep 11 00:09:01.282533 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 434/868] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:01 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:01.582203 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:01.582778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:01.590244 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:01.590764 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:01.591245 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:01.591944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:01.592397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:01.592826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:01.734392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:01.743935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c5c3f046-7456-45e7-a4d9-975ae583d915 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1368 microversion: 2.1 time: 0.165615 Sep 11 00:09:01.744851 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 435/869] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:01 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:02.306274 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:02.306855 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] [instance: 7275256b-8e7b-4327-924b-fdde977cb722] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:02.313491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:02.313961 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:02.314390 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:02.315100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:02.315541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:02.315954 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:02.329592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] HTTP exception thrown: Instance 7275256b-8e7b-4327-924b-fdde977cb722 could not be found. Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Request method failure captured: Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 HTTP/1.1 Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSZ9KEotV-xgXls04M_spmQkPHQyft3zNrptsAJGoer8B9a4YO2B2vhXij-PRPN8joum2wDJMAc7DIqYVijle3sUJ5sfQpjziTHjiLmHffCeUyVVBEmhQBGlVu6DEd9WSsJ3nMCWLSmqrosrbbjr1uNie5CngSZ9AcnoU1rE4vlW5mc Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 82b6b05c598d44ee8b8748b6bab1f9e5 Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-TestMinimumBasicScenario-678984429 Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:09:02.331260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_82b6b05c598d44ee8b8748b6bab1f9e5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82b6b05c598d44ee8b8748b6bab1f9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/82b6b05c598d44ee8b8748b6bab1f9e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82b6b05c598d44ee8b8748b6bab1f9e5"}]}] Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-TestMinimumBasicScenario-678984429 Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 82b6b05c598d44ee8b8748b6bab1f9e5 Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-TestMinimumBasicScenario-678984429 Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-TestMinimumBasicScenario-678984429-project Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: fd106d45a1ce4aad9c85c35d4f53af92 Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-TestMinimumBasicScenario-678984429-project Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 7275256b-8e7b-4327-924b-fdde977cb722 could not be found. Sep 11 00:09:02.332797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '7275256b-8e7b-4327-924b-fdde977cb722'} Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7275256b-8e7b-4327-924b-fdde977cb722 could not be found. Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:09:02.333800 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7275256b-8e7b-4327-924b-fdde977cb722 could not be found. Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7275256b-8e7b-4327-924b-fdde977cb722 could not be found. Sep 11 00:09:02.335415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:02.336826 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Returning 404 to user: Instance 7275256b-8e7b-4327-924b-fdde977cb722 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:09:02.336826 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-adf350fb-6253-4a71-966d-9956f49845bb tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722" status: 404 len: 111 microversion: 2.1 time: 0.031089 Sep 11 00:09:02.336826 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 435/870] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:02 2022] GET /compute/v2.1/servers/7275256b-8e7b-4327-924b-fdde977cb722 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:09:02.341563 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-16cc03c8-f08b-424b-bdc0-9d4d8734a692 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] Calling method '.version_select at 0x7f5ab67c13a0>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:02.430411 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-16cc03c8-f08b-424b-bdc0-9d4d8734a692 tempest-TestMinimumBasicScenario-678984429 tempest-TestMinimumBasicScenario-678984429-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1487548508" status: 202 len: 0 microversion: 2.1 time: 0.092601 Sep 11 00:09:02.431054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 436/871] 10.222.0.17 () {58 vars in 1272 bytes} [Sun Sep 11 00:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1487548508 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:09:02.766596 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:02.767243 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:02.774003 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:02.774484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:02.774948 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:02.775642 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:02.776083 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:02.776499 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:02.911589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:02.919925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-244d87bf-ac70-4898-84f5-04bdf271189c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1557 microversion: 2.1 time: 0.157271 Sep 11 00:09:02.920475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 436/872] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:02 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:02.943500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:02.944670 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:02.951044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:02.952183 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:02.952970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:02.953940 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:02.954391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:02.954848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:03.038597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-32a96030-9410-48e9-945e-0521c5f1f853 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096811 Sep 11 00:09:03.038597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 437/873] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Sep 11 00:09:02 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:04.046219 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-6561aed4-036d-4545-876e-93a6e158a697 req-1a39df50-e5aa-472b-a07d-ec6b6542b68c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6945de1c-cdb3-4dd1-bc79-cd8d617396ee", "tag": "f97b3ac5-1d1c-4668-b665-d7b116ff85c0"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:04.059395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-6561aed4-036d-4545-876e-93a6e158a697 req-1a39df50-e5aa-472b-a07d-ec6b6542b68c service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:04.060331 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-6561aed4-036d-4545-876e-93a6e158a697 req-1a39df50-e5aa-472b-a07d-ec6b6542b68c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:04.060949 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-6561aed4-036d-4545-876e-93a6e158a697 req-1a39df50-e5aa-472b-a07d-ec6b6542b68c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:04.074434 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-6561aed4-036d-4545-876e-93a6e158a697 req-1a39df50-e5aa-472b-a07d-ec6b6542b68c service nova] Creating event network-changed:f97b3ac5-1d1c-4668-b665-d7b116ff85c0 for instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee on hv-cinder-85200 Sep 11 00:09:04.092056 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-6561aed4-036d-4545-876e-93a6e158a697 req-1a39df50-e5aa-472b-a07d-ec6b6542b68c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049650 Sep 11 00:09:04.094858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 437/874] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:11.099544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-48829401", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:11.159951 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] validate_networks() for None {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:09:11.448976 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:09:11.449349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:09:11.449820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:09:11.450273 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:09:11.450627 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:09:11.464553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:11.465354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:11.465794 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:11.466517 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:11.467046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:11.467648 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:11.485787 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Getting quotas for project e7928fd61ace426180ed42483ee48994. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:09:11.489826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Getting quotas for user 435e06748e1a43139b1df8e7ff62d805 and project e7928fd61ace426180ed42483ee48994. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:09:11.502082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:09:11.504498 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:09:11.624395 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2354abda-ff10-4b0d-9016-1d229cd65349 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530032 Sep 11 00:09:11.625051 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 438/875] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:09:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:09:11.638654 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-825f85a4-097d-4219-ba23-ad9b2f950790 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:11.640426 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-825f85a4-097d-4219-ba23-ad9b2f950790 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:11.694029 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-825f85a4-097d-4219-ba23-ad9b2f950790 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:11.701429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-825f85a4-097d-4219-ba23-ad9b2f950790 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1213 microversion: 2.1 time: 0.067929 Sep 11 00:09:11.702259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 438/876] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:11 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:09:12.728229 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:12.729654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:12.736482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:12.736962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:12.737394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:12.738086 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:12.738535 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:12.738986 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:12.811159 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:12.819723 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a5bf6088-23d7-44da-ad8a-81d787b43e8d tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1217 microversion: 2.1 time: 0.098353 Sep 11 00:09:12.820532 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 439/877] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:12 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:13.847303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:13.847913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:13.854999 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:13.855492 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:13.855931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:13.856619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:13.857065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:13.857502 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:13.929503 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:13.936881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bc24be82-5b8d-4078-a0ae-7c690eb29d95 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1265 microversion: 2.1 time: 0.093388 Sep 11 00:09:13.937908 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 439/878] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:13 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:14.961707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:14.962330 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:14.968885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:14.969330 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:14.969765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:14.970460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:14.970936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:14.971354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:15.176991 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:15.185638 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-55fccb90-b7f4-4168-8262-4695e0dfdd9e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1313 microversion: 2.1 time: 0.228652 Sep 11 00:09:15.186218 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 440/879] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:14 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:16.181739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-bfc33bd0-1484-4579-b372-f4e9f660d1ac req-00d10758-6ebe-4682-b1dc-ba61700b8feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fbace0-13f9-45ae-8313-ec61d9725372", "tag": "5683258a-10f0-44c7-b2a2-448182b7d593"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:16.193198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-bfc33bd0-1484-4579-b372-f4e9f660d1ac req-00d10758-6ebe-4682-b1dc-ba61700b8feb service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:16.193668 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-bfc33bd0-1484-4579-b372-f4e9f660d1ac req-00d10758-6ebe-4682-b1dc-ba61700b8feb service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:16.195184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-bfc33bd0-1484-4579-b372-f4e9f660d1ac req-00d10758-6ebe-4682-b1dc-ba61700b8feb service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:16.209290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:16.210734 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:16.220846 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:16.223217 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:16.224025 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:16.224908 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:16.226299 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:16.226753 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:16.227033 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-bfc33bd0-1484-4579-b372-f4e9f660d1ac req-00d10758-6ebe-4682-b1dc-ba61700b8feb service nova] Creating event network-changed:5683258a-10f0-44c7-b2a2-448182b7d593 for instance f3fbace0-13f9-45ae-8313-ec61d9725372 on hv-cinder-85200 Sep 11 00:09:16.236669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-bfc33bd0-1484-4579-b372-f4e9f660d1ac req-00d10758-6ebe-4682-b1dc-ba61700b8feb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060618 Sep 11 00:09:16.238935 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 440/880] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:16.436593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:16.441236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:16.446916 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-28b15d6b-3805-46b1-95ec-e18cc954c464 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1313 microversion: 2.1 time: 0.241160 Sep 11 00:09:16.448010 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 441/881] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:16 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:09:17.471544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:17.472279 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:17.480226 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:17.480714 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:17.481147 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:17.481833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:17.482283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:17.482742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:17.717981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:17.720727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:17.727052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6d3a6d38-1ca7-4953-94f5-49c510dc80dc tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1313 microversion: 2.1 time: 0.259621 Sep 11 00:09:17.727754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 441/882] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:17 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:09:18.751540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:18.753064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:18.761595 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:18.762080 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:18.762508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:18.763236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:18.763681 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:18.764093 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:18.939559 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:18.948581 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9fe3a0ca-d345-4fac-9906-78e2ecd327b8 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1313 microversion: 2.1 time: 0.201225 Sep 11 00:09:18.949148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 442/883] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:18 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:19.976226 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:19.976840 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:19.984280 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:19.990004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:19.990004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:19.990004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:19.990004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:19.990407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:20.133510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:20.143754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-aa359c14-fd15-4c25-8c98-91c913dab284 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1313 microversion: 2.1 time: 0.173951 Sep 11 00:09:20.144340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 442/884] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:19 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:21.167795 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:21.169334 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:21.176619 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:21.177353 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:21.178281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:21.179461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:21.179915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:21.180661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:21.392899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:21.401955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5440ee2b-a920-4ebe-8c7c-7293c0901c28 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1313 microversion: 2.1 time: 0.238129 Sep 11 00:09:21.413256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 443/885] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:21 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:21.667121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-79b02b17-3032-49f6-9b01-625df04b0ae3 req-3edd6dae-bdc7-4e5f-835e-733095f36b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fbace0-13f9-45ae-8313-ec61d9725372", "name": "network-vif-plugged", "status": "completed", "tag": "5683258a-10f0-44c7-b2a2-448182b7d593"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:21.679121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-79b02b17-3032-49f6-9b01-625df04b0ae3 req-3edd6dae-bdc7-4e5f-835e-733095f36b2c service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:21.679819 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-79b02b17-3032-49f6-9b01-625df04b0ae3 req-3edd6dae-bdc7-4e5f-835e-733095f36b2c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:21.680443 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-79b02b17-3032-49f6-9b01-625df04b0ae3 req-3edd6dae-bdc7-4e5f-835e-733095f36b2c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:21.695644 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-79b02b17-3032-49f6-9b01-625df04b0ae3 req-3edd6dae-bdc7-4e5f-835e-733095f36b2c service nova] Creating event network-vif-plugged:5683258a-10f0-44c7-b2a2-448182b7d593 for instance f3fbace0-13f9-45ae-8313-ec61d9725372 on hv-cinder-85200 Sep 11 00:09:21.702807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-79b02b17-3032-49f6-9b01-625df04b0ae3 req-3edd6dae-bdc7-4e5f-835e-733095f36b2c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039585 Sep 11 00:09:21.703737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 443/886] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:22.426346 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:22.426931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:22.428868 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:22.429676 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=6 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:22.435165 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:22.435655 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:22.436083 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:22.437222 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:22.437925 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:22.438264 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:22.718425 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:22.729286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a1bce2ae-84a1-48c9-a136-69882a5069ff tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1313 microversion: 2.1 time: 0.307475 Sep 11 00:09:22.730512 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 444/887] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:22 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:23.753323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:23.754025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:23.756327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:23.759128 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=50 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:23.764216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:23.764745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:23.765466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:23.766161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:23.766828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:23.767415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:24.082060 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:24.095302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c06c284e-9816-4d6d-8182-a9780e2785d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1313 microversion: 2.1 time: 0.345835 Sep 11 00:09:24.096179 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 444/888] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:23 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:25.118910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:25.125303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:25.127597 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:25.128784 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:25.129834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:25.132632 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:25.133370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:25.135502 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:25.368502 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:25.377421 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d95dfcc8-f71f-4a45-b638-964ae1e821d4 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1463 microversion: 2.1 time: 0.263233 Sep 11 00:09:25.378428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 445/889] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:25 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1463 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:25.429762 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:25.430247 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:25.437156 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:25.437879 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:25.438471 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:25.439190 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:25.439631 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:25.440230 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:25.467590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Going to try to terminate instance {{(pid=121068) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:09:25.805756 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c0c95a41-6ae9-4240-b498-031507668e71 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 204 len: 0 microversion: 2.1 time: 0.380047 Sep 11 00:09:25.806612 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 445/890] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:09:25 2022] DELETE /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:09:25.814993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:25.815749 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:25.824226 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:25.824788 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:25.825404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:25.826533 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:25.827365 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:25.827853 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:26.287943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:26.299349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6fc35526-d1fb-4ac8-911d-b4a154064903 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1469 microversion: 2.1 time: 0.486400 Sep 11 00:09:26.299349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 446/891] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:25 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1469 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:26.842463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fe6ab913-e88d-4797-877d-dbbc0f469fee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Action: 'create', calling method: .version_select at 0x7f5ab67523a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-280477967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjg0bd6wENOcntinvOAkTZCyAewqCYvJZBKWDhSX0FbpiBm+kMhlq0QSOzZDRbrTh97Um7VJOmTVJ/AYU2bp6bbo+a5dGwT1YeeF+qdVvDK4LgVvdjJ6Qi78Nf1YKA0aw=="}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:26.859120 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-fe6ab913-e88d-4797-877d-dbbc0f469fee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Getting quotas for project a819c981f44e4d21ab8b8289d16c19fb. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:09:26.863189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-fe6ab913-e88d-4797-877d-dbbc0f469fee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Getting quotas for user aa4f534ee1ab4e639e99b9e4ebbe8363 and project a819c981f44e4d21ab8b8289d16c19fb. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:09:26.938573 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fe6ab913-e88d-4797-877d-dbbc0f469fee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.284562 Sep 11 00:09:26.939212 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 446/892] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:09:26 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:27.321699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:27.322308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:27.324600 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:27.329567 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:27.330043 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:27.330473 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:27.331189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:27.331636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:27.332052 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:27.517405 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:27.528601 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-525be79a-0882-48c1-b22b-c45b13b52469 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1469 microversion: 2.1 time: 0.210852 Sep 11 00:09:27.529321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 447/893] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:27 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:28.023200 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-000fe93b-b425-4208-a9a6-5ad5b31e1c23 req-6740a099-de35-459f-b623-e3a8a74944b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fbace0-13f9-45ae-8313-ec61d9725372", "name": "network-vif-deleted", "tag": "5683258a-10f0-44c7-b2a2-448182b7d593"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:28.033964 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-000fe93b-b425-4208-a9a6-5ad5b31e1c23 req-6740a099-de35-459f-b623-e3a8a74944b3 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:28.034751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-000fe93b-b425-4208-a9a6-5ad5b31e1c23 req-6740a099-de35-459f-b623-e3a8a74944b3 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:28.035370 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-000fe93b-b425-4208-a9a6-5ad5b31e1c23 req-6740a099-de35-459f-b623-e3a8a74944b3 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:28.047883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-000fe93b-b425-4208-a9a6-5ad5b31e1c23 req-6740a099-de35-459f-b623-e3a8a74944b3 service nova] Creating event network-vif-deleted:5683258a-10f0-44c7-b2a2-448182b7d593 for instance f3fbace0-13f9-45ae-8313-ec61d9725372 on hv-cinder-85200 Sep 11 00:09:28.056772 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-000fe93b-b425-4208-a9a6-5ad5b31e1c23 req-6740a099-de35-459f-b623-e3a8a74944b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Sep 11 00:09:28.057690 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 447/894] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:28.553839 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:28.554626 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:28.563069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:28.563757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:28.564301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:28.565558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:28.566215 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:28.567060 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:28.625513 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:28.626004 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:28.626438 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:28.626917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lazy-loading 'fault' on Instance uuid f3fbace0-13f9-45ae-8313-ec61d9725372 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:09:28.677290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e06748e1a43139b1df8e7ff62d805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7928fd61ace426180ed42483ee48994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:28.687123 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-da14d505-63ab-4a44-9a1d-143fe8864382 tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 200 len: 1303 microversion: 2.1 time: 0.138478 Sep 11 00:09:28.688068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 448/895] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:28 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:29.718305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:29.719039 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] [instance: f3fbace0-13f9-45ae-8313-ec61d9725372] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:29.726294 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:29.726923 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:29.727453 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:29.728359 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:29.728808 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:29.729424 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:29.745062 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] HTTP exception thrown: Instance f3fbace0-13f9-45ae-8313-ec61d9725372 could not be found. Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Request method failure captured: Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 HTTP/1.1 Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHSclSwKO5wne_bDZgkSRQ_SeGWQpTz2n21qE-tKSV93XYLpdF5xqyutdbjKlOkZxnOZX-I0lTxo7bRgK-W0pJW1kdrpGLlnsQm0iZ1RJw9658GpaoYUv8iFzqQjgoKTUNVAUElmAm5tipD35n1nHLe-tdHHfnWMi2vv-3ZXrFJ1aqMA Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: e7928fd61ace426180ed42483ee48994 Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-VolumesNegativeTest-132744674 Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:09:29.746803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7928fd61ace426180ed42483ee48994", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7928fd61ace426180ed42483ee48994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7928fd61ace426180ed42483ee48994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7928fd61ace426180ed42483ee48994"}]}] Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-VolumesNegativeTest-132744674 Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: e7928fd61ace426180ed42483ee48994 Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-VolumesNegativeTest-132744674 Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-VolumesNegativeTest-132744674-project Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 435e06748e1a43139b1df8e7ff62d805 Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-VolumesNegativeTest-132744674-project Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance f3fbace0-13f9-45ae-8313-ec61d9725372 could not be found. Sep 11 00:09:29.748440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'f3fbace0-13f9-45ae-8313-ec61d9725372'} Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fbace0-13f9-45ae-8313-ec61d9725372 could not be found. Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:09:29.749391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fbace0-13f9-45ae-8313-ec61d9725372 could not be found. Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fbace0-13f9-45ae-8313-ec61d9725372 could not be found. Sep 11 00:09:29.751101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:09:29.753129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] Returning 404 to user: Instance f3fbace0-13f9-45ae-8313-ec61d9725372 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:09:29.753983 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-091ec9d0-c740-4d30-a3c5-70547996903e tempest-VolumesNegativeTest-132744674 tempest-VolumesNegativeTest-132744674-project] 10.222.0.17 "GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372" status: 404 len: 111 microversion: 2.1 time: 0.040370 Sep 11 00:09:29.754533 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 448/896] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:29 2022] GET /compute/v2.1/servers/f3fbace0-13f9-45ae-8313-ec61d9725372 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:09:40.489701 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:40.490246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:40.493429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=44 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:40.499637 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:40.500162 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:40.500604 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:40.502322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:40.502322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:40.502322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:40.527474 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-38bd0a89-ce6c-4f5d-9402-3be2ba621491 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/ips" status: 200 len: 149 microversion: 2.1 time: 0.041722 Sep 11 00:09:40.530591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 449/897] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:09:40 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:44.310856 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "758cb2ce-bf3c-4c30-8fec-3c6ada2c2999"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:44.313330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:44.315831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=4 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:44.316489 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:44.317114 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:44.321700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:44.322183 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:44.322620 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:44.325329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:44.325329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:44.325329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:45.090084 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2b9d0a2a-b715-4797-9b50-c5073b026174 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783557 Sep 11 00:09:45.097458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 449/898] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:09:44 2022] POST /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments => generated 194 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:48.664273 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2120506629", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-280477967", "security_groups": [{"name": "tempest-secgroup-smoke-106989926"}], "block_device_mapping_v2": [{"uuid": "0b6c6496-bb6c-46b1-8dbb-70ff1dc332cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcdda1c5-3ab3-4fad-9f02-121ff2f99084"}]}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:48.777428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] validate_networks() for [('fcdda1c5-3ab3-4fad-9f02-121ff2f99084', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:09:49.137715 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:09:49.138129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:09:49.138817 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:09:49.139235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:09:49.139639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:09:49.148391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:49.148863 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:49.149292 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:49.150002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:49.150447 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:49.150899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:49.167090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Getting quotas for project a819c981f44e4d21ab8b8289d16c19fb. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:09:49.171287 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Getting quotas for user aa4f534ee1ab4e639e99b9e4ebbe8363 and project a819c981f44e4d21ab8b8289d16c19fb. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:09:49.226877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:09:49.228858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b6c6496-bb6c-46b1-8dbb-70ff1dc332cf',volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:09:49.652856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e102d909-6ce0-40d1-9efb-2a493406de10 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.992425 Sep 11 00:09:49.653523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 450/899] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:09:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:09:49.666220 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b63d500c-34cd-476c-a572-b31deebfcb75 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:49.666937 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b63d500c-34cd-476c-a572-b31deebfcb75 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:49.724079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b63d500c-34cd-476c-a572-b31deebfcb75 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:49.731134 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b63d500c-34cd-476c-a572-b31deebfcb75 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1094 microversion: 2.1 time: 0.069433 Sep 11 00:09:49.731754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 450/900] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:49 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:50.754797 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:50.755419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:50.761639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:50.762117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:50.762610 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:50.763257 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:50.764148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:50.764336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:50.834076 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:50.842390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9ac7c053-5f8b-4784-aced-53b36e4e61ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1144 microversion: 2.1 time: 0.091529 Sep 11 00:09:50.843198 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 451/901] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:50 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:51.864711 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:51.865323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:51.874846 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:51.875333 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:51.875768 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:51.876456 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:51.876905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:51.877329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:51.941742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:51.949601 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8e0d90da-e4a1-4cf4-bee9-4344b68c29b3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1192 microversion: 2.1 time: 0.088772 Sep 11 00:09:51.950178 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 451/902] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:51 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:52.974368 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:52.975008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:52.981568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:52.982066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:52.983094 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:52.983893 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:52.984354 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:52.984786 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:53.070637 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:53.080989 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9aa5998e-d00f-4bc7-9545-397bf68c7eba tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1200 microversion: 2.1 time: 0.110435 Sep 11 00:09:53.085476 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 452/903] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:52 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1200 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:09:53.718755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9d77e141-4d30-4f30-a7e6-612c208c3769 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: .version_select at 0x7f5ab6717670>, body: {"keypair": {"name": "tempest-keypair-366217736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm2QVrbbaZ/8J+9/6wPB8oXouKysiOS02t9TqJZ1CpqZowXTSU2jc7qFjDgQIXiQLHLvx+QmS81n//Rl4GmdSbRmU9yC9AulMfyauh0PMq4gQoWdcPCK5+PLXgDtYgbbw=="}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:53.735121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-9d77e141-4d30-4f30-a7e6-612c208c3769 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:09:53.738943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-9d77e141-4d30-4f30-a7e6-612c208c3769 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for user 6ae921c806734b0a8218ea7453e8bd4e and project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:09:53.823739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9d77e141-4d30-4f30-a7e6-612c208c3769 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109757 Sep 11 00:09:53.826572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 452/904] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:09:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:09:54.111520 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:54.111981 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:54.118748 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:54.119336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:54.119904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:54.120700 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:54.121253 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:54.121799 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:54.383784 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:54.392031 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6342ebc7-6545-4ba6-845b-e7d652646781 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1277 microversion: 2.1 time: 0.286062 Sep 11 00:09:54.392610 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 453/905] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:54 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:54.984559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-84b249fa-4a7a-4a1c-9267-14f5fcc2ab22 req-e5cbf2bd-43b1-40fb-8236-e218a6d1705d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba7a8eb-372f-4d28-8f68-547e780658a5", "tag": "20576cc6-0405-423f-95c0-6a0de1b74926"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:54.995188 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-84b249fa-4a7a-4a1c-9267-14f5fcc2ab22 req-e5cbf2bd-43b1-40fb-8236-e218a6d1705d service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:54.998638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-84b249fa-4a7a-4a1c-9267-14f5fcc2ab22 req-e5cbf2bd-43b1-40fb-8236-e218a6d1705d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:54.998638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-84b249fa-4a7a-4a1c-9267-14f5fcc2ab22 req-e5cbf2bd-43b1-40fb-8236-e218a6d1705d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:55.007033 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-84b249fa-4a7a-4a1c-9267-14f5fcc2ab22 req-e5cbf2bd-43b1-40fb-8236-e218a6d1705d service nova] Creating event network-changed:20576cc6-0405-423f-95c0-6a0de1b74926 for instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 on hv-cinder-85200 Sep 11 00:09:55.012632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-84b249fa-4a7a-4a1c-9267-14f5fcc2ab22 req-e5cbf2bd-43b1-40fb-8236-e218a6d1705d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033833 Sep 11 00:09:55.013224 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 453/906] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:09:55.416953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:55.417553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:55.424090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:55.424570 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:55.424999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:55.425679 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:55.426122 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:55.426540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:55.631656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:55.639958 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6d46ab12-36a4-421a-8912-5799f1abe5c1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.226880 Sep 11 00:09:55.640532 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 454/907] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:55 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:56.603427 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-279006344", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "703dcb23-f6c5-48ec-90e6-3c57db88c851"}], "security_groups": [{"name": "tempest-securitygroup--1209729702"}], "key_name": "tempest-keypair-366217736", "user_data": "}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:09:56.663439 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:56.664047 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:56.670982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:56.671463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:56.671891 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:56.672575 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:56.673038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:56.673454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:56.705753 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] validate_networks() for [('703dcb23-f6c5-48ec-90e6-3c57db88c851', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:09:56.812578 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:56.817856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ebcce5b1-670f-4041-a553-ffab0142b0d5 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.158195 Sep 11 00:09:56.818420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 455/908] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:56 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:09:57.088369 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:09:57.088831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:09:57.089295 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:09:57.089725 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:09:57.090155 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:09:57.099011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:57.099482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:57.099912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:57.100627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:57.101069 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:57.101486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:57.118174 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:09:57.122116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for user 6ae921c806734b0a8218ea7453e8bd4e and project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:09:57.133554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:09:57.136121 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:09:57.269929 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e317903f-e2f9-435c-b49c-ce3e5ae14458 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671131 Sep 11 00:09:57.270580 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 454/909] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:09:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:09:57.281873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-31bd459d-2e46-4d68-895b-6443495bfec4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:57.282526 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-31bd459d-2e46-4d68-895b-6443495bfec4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:57.339184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-31bd459d-2e46-4d68-895b-6443495bfec4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:57.346024 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-31bd459d-2e46-4d68-895b-6443495bfec4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1240 microversion: 2.1 time: 0.068146 Sep 11 00:09:57.346588 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 456/910] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:57 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:57.841417 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:57.842649 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:57.849692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:57.855435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:57.855435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:57.855435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:57.855435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:57.855785 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:57.983372 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:57.990978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6a33cb52-3f9a-4c3a-b1d8-154628831bf6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.154093 Sep 11 00:09:57.991534 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 455/911] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:57 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:58.369360 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:58.369973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:58.377915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:58.378391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:58.378866 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:58.379558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:58.380002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:58.380427 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:58.440697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:58.448394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-eee12294-7301-4145-83a0-282caad9ea9c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1244 microversion: 2.1 time: 0.082960 Sep 11 00:09:58.448954 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 457/912] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:58 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:59.013465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:59.014113 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:59.020692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:59.024694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:59.024694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:59.024694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:59.024694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:59.025074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:59.153496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:59.161899 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5bfca629-914c-4743-8bb1-e481a47ce6ea tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.152497 Sep 11 00:09:59.162457 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 456/913] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:59 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:09:59.471848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:09:59.472463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:09:59.475369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:09:59.480824 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:59.481312 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:59.481745 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:59.482431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:09:59.482954 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:09:59.483377 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:09:59.557026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:09:59.565036 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-635948ed-4634-4c60-bcdc-07feed88f503 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1300 microversion: 2.1 time: 0.097092 Sep 11 00:09:59.565605 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 458/914] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:09:59 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:00.185418 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:00.186649 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:00.193184 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:00.193695 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:00.194130 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:00.194851 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:00.195304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:00.195721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:00.328761 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:00.336572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-59113169-14b7-427d-b3ad-c6f3bc443d48 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.155121 Sep 11 00:10:00.337137 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 457/915] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:00 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:00.589003 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:00.589614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:00.596682 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:00.597155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:00.597584 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:00.598267 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:00.598737 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:00.599182 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:00.660329 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:00.668000 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9b8603f6-b4ec-461e-b559-e4d96f30ee33 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1298 microversion: 2.1 time: 0.083247 Sep 11 00:10:00.668557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 459/916] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:00 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:10:01.359385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:01.360118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:01.366556 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:01.367079 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:01.367521 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:01.368224 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:01.368679 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:01.369105 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:01.505412 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:01.513303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-91313766-f233-46c3-897f-9c7ceed8f72a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.158727 Sep 11 00:10:01.513931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 458/917] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:01 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:01.691631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:01.692294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:01.699533 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:01.700287 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:01.700953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:01.701477 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-65dfc139-b161-43f2-8e92-ba9b9b7972b4 req-dc2302f4-19c0-4f2e-bfff-a32f6ad9cd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbc9c2d-254f-49b0-b81c-f25d3f988f11", "tag": "d5de1efd-0097-49b9-ab6c-83571e2c6fa7"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:01.701894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:01.702467 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:01.703272 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:01.711568 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-65dfc139-b161-43f2-8e92-ba9b9b7972b4 req-dc2302f4-19c0-4f2e-bfff-a32f6ad9cd69 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:01.712048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-65dfc139-b161-43f2-8e92-ba9b9b7972b4 req-dc2302f4-19c0-4f2e-bfff-a32f6ad9cd69 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:01.712481 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-65dfc139-b161-43f2-8e92-ba9b9b7972b4 req-dc2302f4-19c0-4f2e-bfff-a32f6ad9cd69 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:01.726292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-65dfc139-b161-43f2-8e92-ba9b9b7972b4 req-dc2302f4-19c0-4f2e-bfff-a32f6ad9cd69 service nova] Creating event network-changed:d5de1efd-0097-49b9-ab6c-83571e2c6fa7 for instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 on hv-cinder-85200 Sep 11 00:10:01.731561 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-65dfc139-b161-43f2-8e92-ba9b9b7972b4 req-dc2302f4-19c0-4f2e-bfff-a32f6ad9cd69 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033824 Sep 11 00:10:01.733755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 459/918] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:10:01.846380 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:01.854244 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d295295d-6cfc-40fc-b3ed-f9c045044eee tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1366 microversion: 2.1 time: 0.166867 Sep 11 00:10:01.854826 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 460/919] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:01 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:02.538091 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:02.538848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:02.545005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:02.545482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:02.545911 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:02.546589 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:02.547062 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:02.547477 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:02.684407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:02.692277 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a759ca17-1cee-49f8-adbc-06be2b111e5b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.158831 Sep 11 00:10:02.693269 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 460/920] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:02 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:10:02.878706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:02.879425 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:02.886104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:02.886679 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:02.887186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:02.887971 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:02.888424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:02.889480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:03.105142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:03.112917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f90260f8-0c2a-4cb6-b869-fea9dc226091 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1366 microversion: 2.1 time: 0.238416 Sep 11 00:10:03.113465 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 461/921] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:02 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:03.715946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:03.716548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:03.723595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:03.724071 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:03.724510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:03.725189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:03.725638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:03.726052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:03.858070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:03.865945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-12e18756-f285-448e-aeb0-e3ac5842cacd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.153934 Sep 11 00:10:03.866505 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 461/922] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:03 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:04.136519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:04.137135 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:04.144346 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:04.144834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:04.145304 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:04.146063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:04.146513 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:04.146962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:04.281803 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:04.289817 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-df52dbf8-0a68-4c50-97eb-cdbf6bf18c38 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1366 microversion: 2.1 time: 0.157351 Sep 11 00:10:04.290379 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 462/923] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:04 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:04.887866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:04.888474 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:04.895397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:04.895877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:04.896310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:04.896991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:04.897445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:04.897875 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:05.033708 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:05.041342 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b25e5599-588c-4f1d-90a9-da545677fe09 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.157403 Sep 11 00:10:05.041900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 462/924] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:04 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:05.313622 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:05.314234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:05.320698 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:05.321199 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:05.321650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:05.322342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:05.322833 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:05.323260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:05.456036 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:05.463581 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-36442bc7-7c36-489d-8bff-46111fee4b95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1366 microversion: 2.1 time: 0.154625 Sep 11 00:10:05.464139 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 463/925] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:05 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:05.824653 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-4e107964-a11a-4fb1-ab70-5472b29a1b1e req-fcc70d7c-ab67-4b6a-baf2-fb64c40b67b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba7a8eb-372f-4d28-8f68-547e780658a5", "name": "network-vif-plugged", "status": "completed", "tag": "20576cc6-0405-423f-95c0-6a0de1b74926"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:05.834649 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-4e107964-a11a-4fb1-ab70-5472b29a1b1e req-fcc70d7c-ab67-4b6a-baf2-fb64c40b67b2 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:05.835149 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-4e107964-a11a-4fb1-ab70-5472b29a1b1e req-fcc70d7c-ab67-4b6a-baf2-fb64c40b67b2 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:05.835575 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-4e107964-a11a-4fb1-ab70-5472b29a1b1e req-fcc70d7c-ab67-4b6a-baf2-fb64c40b67b2 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:05.847440 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-4e107964-a11a-4fb1-ab70-5472b29a1b1e req-fcc70d7c-ab67-4b6a-baf2-fb64c40b67b2 service nova] Creating event network-vif-plugged:20576cc6-0405-423f-95c0-6a0de1b74926 for instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 on hv-cinder-85200 Sep 11 00:10:05.852064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-4e107964-a11a-4fb1-ab70-5472b29a1b1e req-fcc70d7c-ab67-4b6a-baf2-fb64c40b67b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031411 Sep 11 00:10:05.854738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 463/926] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:10:06.064775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:06.066056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:06.072157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:06.072641 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:06.073082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:06.073768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:06.074220 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:06.074642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:06.213834 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:06.222438 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c76a367f-58c4-44b5-b3a2-1f3051f8df24 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.163080 Sep 11 00:10:06.223224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 464/927] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:06 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:06.487084 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:06.487794 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:06.493857 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:06.494416 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:06.494887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:06.495573 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:06.496025 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:06.496449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:06.624295 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:06.632718 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-df3b82f3-d445-422c-9a10-423db0fd8664 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1366 microversion: 2.1 time: 0.151024 Sep 11 00:10:06.633286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 464/928] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:06 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:07.246089 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:07.246714 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:07.253145 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:07.253614 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:07.254038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:07.254736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:07.255184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:07.255596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:07.344278 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=8 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:07.391862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:07.399544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4b3e33ed-ed71-426c-8f39-402407733f67 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1265 microversion: 2.1 time: 0.157320 Sep 11 00:10:07.400118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 465/929] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:07 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:07.656632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:07.657388 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:07.659354 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:07.660028 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=12 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:07.665290 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:07.665734 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:07.666165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:07.666891 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:07.667334 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:07.667754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:07.802622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:07.811470 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e519862c-dda8-43e9-b1e0-91f2184db9ec tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1366 microversion: 2.1 time: 0.158710 Sep 11 00:10:07.813533 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 465/930] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:07 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:07.883721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-49989de3-8797-4350-9362-6b2d46023ab7 req-038adc7d-fb74-4257-b06b-3b93778984f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbc9c2d-254f-49b0-b81c-f25d3f988f11", "name": "network-vif-plugged", "status": "completed", "tag": "d5de1efd-0097-49b9-ab6c-83571e2c6fa7"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:07.893471 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-49989de3-8797-4350-9362-6b2d46023ab7 req-038adc7d-fb74-4257-b06b-3b93778984f1 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:07.893944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-49989de3-8797-4350-9362-6b2d46023ab7 req-038adc7d-fb74-4257-b06b-3b93778984f1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:07.894366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-49989de3-8797-4350-9362-6b2d46023ab7 req-038adc7d-fb74-4257-b06b-3b93778984f1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:07.906881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-49989de3-8797-4350-9362-6b2d46023ab7 req-038adc7d-fb74-4257-b06b-3b93778984f1 service nova] Creating event network-vif-plugged:d5de1efd-0097-49b9-ab6c-83571e2c6fa7 for instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 on hv-cinder-85200 Sep 11 00:10:07.912019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-49989de3-8797-4350-9362-6b2d46023ab7 req-038adc7d-fb74-4257-b06b-3b93778984f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031900 Sep 11 00:10:07.916639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 466/931] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:10:08.421367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:08.423048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:08.429044 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:08.429524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:08.429960 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:08.430648 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:08.431123 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:08.431547 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:08.567000 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:08.575035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-5ef279d2-e644-4cb8-a8ba-17c8a8107df3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1452 microversion: 2.1 time: 0.157516 Sep 11 00:10:08.575616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 466/932] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:08 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:08.599867 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:08.600557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:08.606603 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:08.607134 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:08.607559 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:08.608242 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:08.608687 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:08.609635 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:08.742492 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:08.750954 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a8e610f2-54ec-4e76-8a61-2f7e2af1a6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1452 microversion: 2.1 time: 0.155772 Sep 11 00:10:08.751526 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 467/933] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:08 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:10:08.835889 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:08.836503 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:08.842939 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:08.843952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:08.844407 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:08.845296 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:08.845749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:08.846173 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:09.000420 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:09.008185 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d71eaf91-7d07-44c5-b5db-a4277ec902b1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1366 microversion: 2.1 time: 0.176177 Sep 11 00:10:09.008778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 467/934] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:08 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:10.032603 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:10.033199 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:10.039094 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:10.039761 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:10.040211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:10.040966 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:10.041762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:10.042183 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:10.046458 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:10.314577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:10.322343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f648f842-afb9-4baf-bd31-ea35ecb23b4d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1555 microversion: 2.1 time: 0.295282 Sep 11 00:10:10.322959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 468/935] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:10 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1555 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:10.345667 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:10.346177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:10.352791 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:10.353274 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:10.354119 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:10.354403 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:10.354887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:10.355311 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:10.436316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-22c6fd3b-e8e1-403d-a8a8-33ad4788e4a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094643 Sep 11 00:10:10.436930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 468/936] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Sep 11 00:10:10 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:10:11.233672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-73e1f290-d722-4437-b5dc-540236f28fdf req-71339530-4d98-46ce-b419-a65d6cfdd900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba7a8eb-372f-4d28-8f68-547e780658a5", "tag": "20576cc6-0405-423f-95c0-6a0de1b74926"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:11.241491 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:11.245201 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-73e1f290-d722-4437-b5dc-540236f28fdf req-71339530-4d98-46ce-b419-a65d6cfdd900 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:11.245840 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-73e1f290-d722-4437-b5dc-540236f28fdf req-71339530-4d98-46ce-b419-a65d6cfdd900 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:11.246423 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-73e1f290-d722-4437-b5dc-540236f28fdf req-71339530-4d98-46ce-b419-a65d6cfdd900 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:11.257698 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-73e1f290-d722-4437-b5dc-540236f28fdf req-71339530-4d98-46ce-b419-a65d6cfdd900 service nova] Creating event network-changed:20576cc6-0405-423f-95c0-6a0de1b74926 for instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 on hv-cinder-85200 Sep 11 00:10:11.262487 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-73e1f290-d722-4437-b5dc-540236f28fdf req-71339530-4d98-46ce-b419-a65d6cfdd900 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 Sep 11 00:10:11.263428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 469/937] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:10:11.453927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-f33343f1-3974-476d-bf63-fcc67da6acac req-9d9108cb-a266-42d8-a2df-79fc9a309910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbc9c2d-254f-49b0-b81c-f25d3f988f11", "tag": "d5de1efd-0097-49b9-ab6c-83571e2c6fa7"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:11.466068 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f33343f1-3974-476d-bf63-fcc67da6acac req-9d9108cb-a266-42d8-a2df-79fc9a309910 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:11.466649 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f33343f1-3974-476d-bf63-fcc67da6acac req-9d9108cb-a266-42d8-a2df-79fc9a309910 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:11.467106 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f33343f1-3974-476d-bf63-fcc67da6acac req-9d9108cb-a266-42d8-a2df-79fc9a309910 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:11.471848 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:11.479980 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-f33343f1-3974-476d-bf63-fcc67da6acac req-9d9108cb-a266-42d8-a2df-79fc9a309910 service nova] Creating event network-changed:d5de1efd-0097-49b9-ab6c-83571e2c6fa7 for instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 on hv-cinder-85200 Sep 11 00:10:11.486325 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-f33343f1-3974-476d-bf63-fcc67da6acac req-9d9108cb-a266-42d8-a2df-79fc9a309910 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037420 Sep 11 00:10:11.487693 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 469/938] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:10:42.690002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=6 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:42.695456 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:42.696097 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:42.702625 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:42.705047 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:42.705047 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:42.705047 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:42.705047 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:42.705415 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:42.728983 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lazy-loading 'flavor' on Instance uuid 902ccc1c-f002-4a8a-aa95-f84cea72606a {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:10:43.045621 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-010dc859-9065-4f90-bc6a-077f27a2dc63 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "POST /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a/action" status: 202 len: 0 microversion: 2.1 time: 0.356906 Sep 11 00:10:43.046179 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 470/939] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:10:42 2022] POST /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:10:43.056822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:43.095281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:43.095281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:43.095281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:43.095281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:43.095281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:43.096218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:43.096218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:43.096218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:43.217352 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:43.226057 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8647c002-b910-4f85-93d2-a1a75bfe8b6c tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.175210 Sep 11 00:10:43.228470 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 470/940] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:43 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:44.250409 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:44.251213 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:44.257988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:44.258475 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:44.259033 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:44.259699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:44.260146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:44.260562 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:44.399348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:44.407406 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-00cc8d01-11f0-4fcf-9071-99091d909db9 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.161606 Sep 11 00:10:44.408293 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 471/941] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:44 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:45.431198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:45.431838 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:45.439531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:45.440011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:45.440445 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:45.441145 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:45.441593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:45.442546 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:45.579041 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:45.587660 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a2b202a9-0bee-4493-b587-0065088e2d67 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.160374 Sep 11 00:10:45.588453 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 471/942] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:45 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:46.611724 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:46.612239 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:46.619211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:46.619678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:46.620109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:46.620793 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:46.621236 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:46.621646 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:46.758198 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:46.766392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-59921005-4152-4130-a15c-29cff65b41bf tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.158501 Sep 11 00:10:46.767203 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 472/943] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:46 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:47.796330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:47.796943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:47.803837 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:47.804311 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:47.804739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:47.805454 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:47.805870 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:47.806285 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:47.826833 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:47.828144 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:47.837026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:47.837556 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:47.838697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:47.842629 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:47.843180 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:47.843661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:47.869279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-dcb91f7e-755b-4da2-a41d-51d9f1137b89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11/ips" status: 200 len: 149 microversion: 2.1 time: 0.046401 Sep 11 00:10:47.869861 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 473/944] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:10:47 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:10:47.881674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "758cb2ce-bf3c-4c30-8fec-3c6ada2c2999"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:47.884273 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:47.890207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:47.890702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:47.891131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:47.891821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:47.892553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:47.893848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:47.950581 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:47.959727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3a77c39a-92cd-4f08-adbf-b42040baea04 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.167269 Sep 11 00:10:47.960331 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 472/945] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:47 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:47.984485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Invalid volume: volume 758cb2ce-bf3c-4c30-8fec-3c6ada2c2999 is already attached to instances: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: POST /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11/os-volume_attachments HTTP/1.1 Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 74 Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:10:47.986219 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {"volumeAttachment": {"volumeId": "758cb2ce-bf3c-4c30-8fec-3c6ada2c2999"}} Sep 11 00:10:47.987862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Invalid volume: volume 758cb2ce-bf3c-4c30-8fec-3c6ada2c2999 is already attached to instances: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'server_id': 'bdbc9c2d-254f-49b0-b81c-f25d3f988f11', 'body': {'volumeAttachment': {'volumeId': '758cb2ce-bf3c-4c30-8fec-3c6ada2c2999'}}} Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 758cb2ce-bf3c-4c30-8fec-3c6ada2c2999 is already attached to instances: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:10:47.988752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 758cb2ce-bf3c-4c30-8fec-3c6ada2c2999 is already attached to instances: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:10:47.991038 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:10:47.992631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:10:47.992631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:10:47.992631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:10:47.992631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 758cb2ce-bf3c-4c30-8fec-3c6ada2c2999 is already attached to instances: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee Sep 11 00:10:47.992631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:10:47.992631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 400 to user: Invalid volume: volume 758cb2ce-bf3c-4c30-8fec-3c6ada2c2999 is already attached to instances: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:10:47.992631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-662a1733-b5ae-4fd1-84ca-a0f1bfb57d17 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110239 Sep 11 00:10:47.992631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 474/946] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:10:47 2022] POST /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 11 00:10:47.997915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:47.998428 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:48.004491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:48.004976 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:48.005404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:48.006086 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:48.006530 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:48.007122 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:48.034904 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Going to try to terminate instance {{(pid=121068) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:10:48.331194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b0d9dfc4-5d34-4eda-86d9-bb65054f84ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 204 len: 0 microversion: 2.1 time: 0.336910 Sep 11 00:10:48.331781 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 473/947] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:10:47 2022] DELETE /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:10:48.340894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:48.341510 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:48.349460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:48.354850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:48.354850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:48.354850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:48.354850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:48.355234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:48.495239 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:48.503466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c562f781-9933-465c-992a-4b0cef01cad6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1680 microversion: 2.1 time: 0.166550 Sep 11 00:10:48.504031 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 475/948] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:48 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:48.984081 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:48.984805 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:48.991901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:48.992383 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:48.992814 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:48.993535 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:48.993981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:48.994398 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:49.138468 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:49.146606 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f517ff33-41d6-4ca2-a745-d54bf17c0819 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.166734 Sep 11 00:10:49.147228 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 474/949] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:48 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:49.528570 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:49.529180 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:49.535764 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:49.536956 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:49.537339 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:49.538030 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:49.538480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:49.538935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:49.671349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:49.679337 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2fc3eca2-b5b4-4da5-8cdd-dbad07cd0f7c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1680 microversion: 2.1 time: 0.154843 Sep 11 00:10:49.680019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 476/950] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:49 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:50.171386 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:50.172101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:50.178639 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:50.179150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:50.179584 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:50.180270 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:50.180729 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:50.181149 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:50.314636 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:50.323138 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-553c5edc-7866-438a-bd9e-c2c6f3cfa44a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.156378 Sep 11 00:10:50.323870 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 475/951] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:50 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:50.703333 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:50.704367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:50.711207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:50.711728 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:50.712169 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:50.712860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:50.713440 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:50.713866 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:50.808304 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:50.816257 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0a83d71c-8c87-4300-8a4f-572561f553f2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1612 microversion: 2.1 time: 0.116764 Sep 11 00:10:50.819514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 477/952] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:50 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1612 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:51.088359 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-f1c61245-c0ae-4f7b-8912-2c057207ff06 req-d605c36b-d0af-406f-a334-f7232ccb1fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbc9c2d-254f-49b0-b81c-f25d3f988f11", "name": "network-vif-deleted", "tag": "d5de1efd-0097-49b9-ab6c-83571e2c6fa7"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:51.097956 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f1c61245-c0ae-4f7b-8912-2c057207ff06 req-d605c36b-d0af-406f-a334-f7232ccb1fd7 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:51.099182 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f1c61245-c0ae-4f7b-8912-2c057207ff06 req-d605c36b-d0af-406f-a334-f7232ccb1fd7 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:51.099779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f1c61245-c0ae-4f7b-8912-2c057207ff06 req-d605c36b-d0af-406f-a334-f7232ccb1fd7 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:51.111171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-f1c61245-c0ae-4f7b-8912-2c057207ff06 req-d605c36b-d0af-406f-a334-f7232ccb1fd7 service nova] Creating event network-vif-deleted:d5de1efd-0097-49b9-ab6c-83571e2c6fa7 for instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 on hv-cinder-85200 Sep 11 00:10:51.117172 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-f1c61245-c0ae-4f7b-8912-2c057207ff06 req-d605c36b-d0af-406f-a334-f7232ccb1fd7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032553 Sep 11 00:10:51.118244 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 476/953] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:10:51.356850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:51.356850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:51.356850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:51.356850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:51.357357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:51.357357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:51.357357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:51.357357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:51.491185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:51.500109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3fabc12a-3027-4a84-9faa-5065dceed176 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.156929 Sep 11 00:10:51.500678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 478/954] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:51 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:10:51.845850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:51.846842 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:51.855330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:51.856175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:51.856633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:51.857362 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:51.857771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:51.858211 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:51.896666 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:51.897062 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:51.897522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:51.897968 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lazy-loading 'fault' on Instance uuid bdbc9c2d-254f-49b0-b81c-f25d3f988f11 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:10:51.948598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:51.958272 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f8381d67-44d2-4fb7-bad0-75c8a3f04109 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 200 len: 1330 microversion: 2.1 time: 0.116640 Sep 11 00:10:51.958888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 477/955] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:51 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:52.526975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:52.527543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:52.534109 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:52.534615 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:52.535085 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:52.535778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:52.536279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:52.536650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:52.673050 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:52.681824 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8026ba84-1a77-4252-8de0-5e3f6de82bc5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.158889 Sep 11 00:10:52.682386 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 479/956] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:52 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:52.982113 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:52.983001 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:52.989231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:52.989713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:52.990150 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:52.990881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:52.991332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:52.993089 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:53.004820 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 HTTP/1.1 Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:10:53.006672 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:10:53.008337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'bdbc9c2d-254f-49b0-b81c-f25d3f988f11'} Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:10:53.009751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:10:53.011358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:10:53.013141 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:10:53.013141 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-581d8898-753b-4a49-8537-8efc2f177c98 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 404 len: 111 microversion: 2.1 time: 0.029870 Sep 11 00:10:53.013141 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 478/957] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:52 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:10:53.019523 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b13884c6-d7d5-4a7d-8f52-f8d27b81961e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '.version_select at 0x7f5ab688e430>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:53.102233 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b13884c6-d7d5-4a7d-8f52-f8d27b81961e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366217736" status: 202 len: 0 microversion: 2.1 time: 0.088414 Sep 11 00:10:53.102777 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 480/958] 10.222.0.17 () {58 vars in 1218 bytes} [Sun Sep 11 00:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366217736 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:10:53.705975 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:53.706727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:53.713587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:53.714177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:53.714614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:53.715330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:53.715782 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:53.716199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:53.853213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:53.861704 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-79532957-46ad-4629-b814-f5b18e3ff1ed tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.160694 Sep 11 00:10:53.862271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 479/959] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:53 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:54.390521 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:54.391074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:54.397724 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:54.398221 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:54.398707 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:54.399381 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:54.399838 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:54.400831 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:54.482919 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lazy-loading 'services' on Instance uuid 6945de1c-cdb3-4dd1-bc79-cd8d617396ee {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:10:54.805044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8c932b85-5ee2-47e5-956a-3bab64d6c023 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments/758cb2ce-bf3c-4c30-8fec-3c6ada2c2999" status: 202 len: 0 microversion: 2.1 time: 0.418721 Sep 11 00:10:54.805558 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 481/960] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:10:54 2022] DELETE /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments/758cb2ce-bf3c-4c30-8fec-3c6ada2c2999 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:10:54.814017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:54.816201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:54.823425 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:54.823912 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:54.824354 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:54.825055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:54.825508 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:54.825931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:54.859948 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4fb6734f-6737-43fa-923e-f21a482edb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049803 Sep 11 00:10:54.860508 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 480/961] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:10:54 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:10:54.885229 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:54.885928 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:54.892202 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:54.892686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:54.893128 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:54.893940 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:54.894399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:54.894867 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:55.048898 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:55.057108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-27434047-c086-406d-9bdb-3437ce33344b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.176024 Sep 11 00:10:55.057603 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 482/962] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:54 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:10:55.874467 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:55.876631 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:55.883303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:55.883786 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:55.884218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:55.884907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:55.885433 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:55.885851 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:55.920746 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9507ade0-8c47-453f-b225-9b4b9ebf2dde tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050776 Sep 11 00:10:55.921316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 481/963] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:10:55 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:10:56.080660 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:56.081281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:56.088425 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:56.088921 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:56.089457 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:56.090137 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:56.090581 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:56.091026 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:56.261712 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:56.269762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-87313223-cadd-4a32-bc46-161b07e5df8e tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.193306 Sep 11 00:10:56.270918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 483/964] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:56 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:56.932861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:56.935013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:56.941239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:56.941707 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:56.942292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:56.942997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:56.943439 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:56.943855 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:56.974799 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c2b679fa-9fb7-4b63-bbcf-2ec2b0dde064 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045740 Sep 11 00:10:56.975363 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 482/965] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:10:56 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:10:57.296312 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:57.296928 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:57.304399 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:57.306805 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:57.306805 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:57.306805 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:57.306805 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:57.307194 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:57.440242 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:57.448343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-00e6fe8b-8e70-4ad7-809b-fbe2fa2799c1 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.156253 Sep 11 00:10:57.448913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 484/966] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:57 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:57.987337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:57.990128 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:57.996715 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:57.997196 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.015151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.015151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.015151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.015151 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.029004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ec26b6cd-ceeb-484e-b0e4-0c3c6e26befd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045676 Sep 11 00:10:58.029561 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 483/967] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:10:57 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:10:58.096800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:58.097288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:58.103842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.104313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.104738 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.105416 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.105859 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.106276 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.110237 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:58.131268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:10:58.393746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-769124ef-b1d6-46e2-bec3-b18f9f88e44b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 204 len: 0 microversion: 2.1 time: 0.300476 Sep 11 00:10:58.394508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 485/968] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:10:58 2022] DELETE /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:10:58.403216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:58.409171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:58.409829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.410306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.411927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.412622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.413073 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.413499 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.472607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:58.474168 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:58.480216 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.480689 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.481115 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.481792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.482235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.482740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.671220 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:58.676779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:58.679302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0665b72e-7efc-488d-91ed-1471ff97c311 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1682 microversion: 2.1 time: 0.279881 Sep 11 00:10:58.680067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 484/969] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:58 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1682 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:58.684620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bc0dc22d-fb99-4c59-ac91-781120ea173d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1571 microversion: 2.1 time: 0.216661 Sep 11 00:10:58.685181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 486/970] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:58 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1571 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:10:58.708233 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:58.708818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:58.714972 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.715475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.715919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.716590 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:58.717038 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:58.717455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:58.745962 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121068) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 00:10:58.842031 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:10:59.013669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-28c903c1-f53a-4d6c-937a-7a6f6daeee7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "POST /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a/action" status: 202 len: 0 microversion: 2.1 time: 0.310162 Sep 11 00:10:59.014367 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 485/971] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Sep 11 00:10:58 2022] POST /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:10:59.024318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:59.025222 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:59.031258 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:59.031751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:59.032314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:59.033092 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:59.033595 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:59.033978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:59.186197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:59.196708 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bfa3c33e-85a2-4669-844e-4f1816cee72d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1519 microversion: 2.1 time: 0.177166 Sep 11 00:10:59.198364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 487/972] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:59 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:10:59.704086 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:10:59.704698 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:10:59.711417 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:59.711898 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:59.712469 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:59.713027 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:59.713483 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:59.713906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:59.824640 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-725888f6-7178-4e9b-967d-a4644e6799a1 req-9d9d39b2-1d60-4821-b57a-0a88404020e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902ccc1c-f002-4a8a-aa95-f84cea72606a", "name": "network-vif-unplugged", "status": "completed", "tag": "b6f168ce-ddb7-4058-81ef-2684d1f44a39"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:10:59.836189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-725888f6-7178-4e9b-967d-a4644e6799a1 req-9d9d39b2-1d60-4821-b57a-0a88404020e4 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:10:59.836791 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-725888f6-7178-4e9b-967d-a4644e6799a1 req-9d9d39b2-1d60-4821-b57a-0a88404020e4 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:10:59.837283 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-725888f6-7178-4e9b-967d-a4644e6799a1 req-9d9d39b2-1d60-4821-b57a-0a88404020e4 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:10:59.849598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.compute.server_external_events [req-725888f6-7178-4e9b-967d-a4644e6799a1 req-9d9d39b2-1d60-4821-b57a-0a88404020e4 service nova] Unable to find a host for instance 902ccc1c-f002-4a8a-aa95-f84cea72606a. Dropping event network-vif-unplugged {{(pid=121067) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 11 00:10:59.850541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-725888f6-7178-4e9b-967d-a4644e6799a1 req-9d9d39b2-1d60-4821-b57a-0a88404020e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030540 Sep 11 00:10:59.851222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:10:59.851387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 488/973] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 11 00:10:59.859042 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b2c12bd4-5da1-4bff-a23d-eefa9738c694 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1682 microversion: 2.1 time: 0.159533 Sep 11 00:10:59.859586 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 486/974] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:10:59 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:00.224302 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:00.224940 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:00.230886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:00.231361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:00.231879 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:00.232577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:00.233020 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:00.233438 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:00.389275 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:00.399474 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b7558238-9da4-4694-bd0b-8f9004aba59a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1519 microversion: 2.1 time: 0.179167 Sep 11 00:11:00.400056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 489/975] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:00 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:00.883123 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:00.883778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:00.890204 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:00.890716 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:00.891164 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:00.891858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:00.892314 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:00.892737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:01.027907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:01.036395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9cc4ae9c-cb4f-42ff-839d-911e03ef5df3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1682 microversion: 2.1 time: 0.156872 Sep 11 00:11:01.037210 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 487/976] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:00 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:01.367299 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-7e24a21a-fb4a-4af3-81cc-73c5f3526785 req-8275a6a1-aab1-44bd-b020-229e5ecce1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6945de1c-cdb3-4dd1-bc79-cd8d617396ee", "name": "network-vif-deleted", "tag": "f97b3ac5-1d1c-4668-b665-d7b116ff85c0"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:11:01.377343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7e24a21a-fb4a-4af3-81cc-73c5f3526785 req-8275a6a1-aab1-44bd-b020-229e5ecce1a1 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:01.377811 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7e24a21a-fb4a-4af3-81cc-73c5f3526785 req-8275a6a1-aab1-44bd-b020-229e5ecce1a1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:01.378268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-7e24a21a-fb4a-4af3-81cc-73c5f3526785 req-8275a6a1-aab1-44bd-b020-229e5ecce1a1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:01.389745 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-7e24a21a-fb4a-4af3-81cc-73c5f3526785 req-8275a6a1-aab1-44bd-b020-229e5ecce1a1 service nova] Creating event network-vif-deleted:f97b3ac5-1d1c-4668-b665-d7b116ff85c0 for instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee on hv-cinder-85200 Sep 11 00:11:01.394609 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-7e24a21a-fb4a-4af3-81cc-73c5f3526785 req-8275a6a1-aab1-44bd-b020-229e5ecce1a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031446 Sep 11 00:11:01.395778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 490/977] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:11:01.427254 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:01.427916 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:01.434160 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:01.434940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:01.435928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:01.437561 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:01.438572 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:01.439118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:01.603189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:01.616798 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-aa45c7e0-78af-416b-a762-261da9202962 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1521 microversion: 2.1 time: 0.197721 Sep 11 00:11:01.617650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 488/978] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:01 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:02.061106 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:02.061804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:02.068606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:02.069105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:02.069537 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:02.070241 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:02.070723 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:02.071146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:02.105181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:02.105777 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:02.106224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:02.106848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lazy-loading 'fault' on Instance uuid 6945de1c-cdb3-4dd1-bc79-cd8d617396ee {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:11:02.149580 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:02.162551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d3fa7a53-0260-4dbf-b8a6-4d443feacaf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 200 len: 1332 microversion: 2.1 time: 0.105612 Sep 11 00:11:02.163177 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 491/979] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:02 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:02.640788 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:02.641401 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:02.648485 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:02.648966 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:02.649398 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:02.650083 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:02.650527 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:02.650985 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:02.787372 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:02.795410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-92a80ffe-b064-4042-929c-1763db0556ac tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.158573 Sep 11 00:11:02.795987 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 489/980] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:02 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:03.185420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:03.186065 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:03.192784 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:03.193261 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:03.193692 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:03.194383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:03.194857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:03.195277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:03.209160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee HTTP/1.1 Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:11:03.210835 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:11:03.212488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '6945de1c-cdb3-4dd1-bc79-cd8d617396ee'} Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:11:03.213389 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:11:03.214918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:11:03.217002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:11:03.217002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-981040d1-b2c2-47e1-a21d-07a188836672 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 404 len: 111 microversion: 2.1 time: 0.030752 Sep 11 00:11:03.217002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 492/981] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:03 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:11:03.221476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-70da1569-4633-4ffa-8696-cb77f552901e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '.version_select at 0x7f5ab6763550>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:03.300312 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-70da1569-4633-4ffa-8696-cb77f552901e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763496671" status: 202 len: 0 microversion: 2.1 time: 0.082823 Sep 11 00:11:03.301797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 490/982] 10.222.0.17 () {58 vars in 1221 bytes} [Sun Sep 11 00:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763496671 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:11:03.819751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:03.820525 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:03.827789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:03.828284 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:03.828978 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:03.829677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:03.830366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:03.830880 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:03.969142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:03.978021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6ea22c04-2d50-4aff-9154-cff8dd3f6736 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.163261 Sep 11 00:11:03.978593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 493/983] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:03 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:04.154044 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-741cdb43-167e-41e7-85dc-d9c47dc2e762 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: .version_select at 0x7f5ab6752d30>, body: {"keypair": {"name": "tempest-keypair-436297842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0xHcf6qSym10KkAxUbB3SBpgeJz0eOKfFCZkOWSJ7uCqBLaEoATyAfBPXQg7sovxEHwMPZHhE6KMRYR7nI4ZVScVpWei1mSEPuIliw7Se9MI2FTCZAwcY7Oo5JjNWzAg=="}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:11:04.170649 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-741cdb43-167e-41e7-85dc-d9c47dc2e762 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:11:04.174574 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-741cdb43-167e-41e7-85dc-d9c47dc2e762 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for user 6ae921c806734b0a8218ea7453e8bd4e and project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:11:04.234415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-741cdb43-167e-41e7-85dc-d9c47dc2e762 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085167 Sep 11 00:11:04.235068 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 491/984] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:11:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:11:05.001545 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:05.002142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:05.009803 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:05.010286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:05.010756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:05.011443 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:05.011918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:05.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:05.161563 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:05.169243 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e44f8d4b-7a51-4582-a013-4f49149dad7a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.171697 Sep 11 00:11:05.169929 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 494/985] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:04 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:06.194105 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:06.194738 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:06.200576 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:06.201054 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:06.201484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:06.202167 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:06.202613 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:06.203045 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:06.336022 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:06.344036 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0c5e8399-d2a0-4c11-a57e-1567633301f7 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.155094 Sep 11 00:11:06.344588 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 492/986] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:06 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:06.627079 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-377755558", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "703dcb23-f6c5-48ec-90e6-3c57db88c851"}], "security_groups": [{"name": "tempest-securitygroup--976142893"}], "key_name": "tempest-keypair-436297842", "user_data": "}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:11:06.731872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] validate_networks() for [('703dcb23-f6c5-48ec-90e6-3c57db88c851', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:11:07.102872 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:11:07.103290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:11:07.103950 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:11:07.104359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:11:07.104763 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:11:07.113722 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:07.114203 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:07.114645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:07.115393 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:07.115886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:07.116338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:07.133175 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:11:07.137256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for user 6ae921c806734b0a8218ea7453e8bd4e and project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:11:07.148885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:11:07.151182 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:11:07.284721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b48b573b-05ce-4cac-a3e9-49fb6299ef46 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.661908 Sep 11 00:11:07.285387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 495/987] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:11:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:11:07.296935 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-95c9d00b-cab2-4529-bbca-e903b242a4cb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:07.297699 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-95c9d00b-cab2-4529-bbca-e903b242a4cb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:07.353377 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-95c9d00b-cab2-4529-bbca-e903b242a4cb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:07.360199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-95c9d00b-cab2-4529-bbca-e903b242a4cb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1240 microversion: 2.1 time: 0.067172 Sep 11 00:11:07.360788 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 493/988] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:07 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:07.367420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:07.368092 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:07.381838 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:07.381838 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:07.382095 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:07.382771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:07.383224 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:07.383645 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:07.521246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:07.529046 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-56e9151f-e3f9-47aa-b235-2359714825b5 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.166162 Sep 11 00:11:07.529604 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 496/989] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:07 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:08.383462 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:08.384035 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:08.391523 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:08.392005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:08.392433 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:08.393122 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:08.393569 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:08.393989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:08.460507 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:08.467194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7a90de8e-596f-4625-8153-3e443709aacb tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1244 microversion: 2.1 time: 0.087758 Sep 11 00:11:08.467753 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 494/990] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:08 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:08.553448 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:08.554049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:08.560480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:08.560957 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:08.561386 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:08.562066 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:08.562511 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:08.562977 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:08.698676 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:08.706757 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-688c31dd-64a6-4d18-8f21-a6a34a3e7c31 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.157893 Sep 11 00:11:08.707846 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 497/991] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:08 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:09.491588 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:09.492227 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:09.499004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:09.499483 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:09.499920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:09.500625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:09.501055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:09.501475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:09.566927 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:09.575253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9a47b43f-88b5-4935-a86d-6ed73433d92a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1300 microversion: 2.1 time: 0.087660 Sep 11 00:11:09.575857 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 495/992] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:09 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:09.731494 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:09.732111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:09.739060 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:09.739554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:09.740001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:09.740702 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:09.741152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:09.741574 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:09.881145 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:09.888909 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1f87363e-1270-4400-a689-ba5ab73a344d tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.161302 Sep 11 00:11:09.889469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 498/993] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:09 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:10.600513 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:10.601147 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:10.607903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:10.608943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:10.609351 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:10.609984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:10.610436 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:10.611074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:10.675760 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:10.684473 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ade16611-1878-475e-893c-88c1b4ba0d6c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1298 microversion: 2.1 time: 0.088670 Sep 11 00:11:10.685206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 496/994] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:10 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:10.913104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:10.913808 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:10.920327 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:10.920884 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:10.921387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:10.922086 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:10.922540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:10.922990 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:11.187935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:11.197628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8c727e19-eee2-48aa-a1d7-28657843d3b3 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.288902 Sep 11 00:11:11.198424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 499/995] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:10 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:11.709231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:11.709830 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:11.716395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:11.716872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:11.717303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:11.717997 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:11.718448 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:11.718976 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:11.856718 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:11.864455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-81997341-b980-46e5-b420-d955e6ccaf80 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.159584 Sep 11 00:11:11.865055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 497/996] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:11 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:12.221429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:12.222108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:12.228923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:12.229403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:12.229831 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:12.230519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:12.231018 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:12.231410 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:12.443800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:12.455217 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4a94dcc5-3757-4000-b028-c7a4f5ca423b tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.237337 Sep 11 00:11:12.456097 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 500/997] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:12 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:11:12.621987 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-f3cc7813-f672-4798-a0b4-f138c9860249 req-1e264bc9-c5b4-4996-a4d3-5998ad0a50b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6cdb29e-dcca-4d50-adf7-2be2674c36d8", "tag": "3ebe6817-897a-4bd5-8e3d-f0a6e9a8b050"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:11:12.632968 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f3cc7813-f672-4798-a0b4-f138c9860249 req-1e264bc9-c5b4-4996-a4d3-5998ad0a50b1 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:12.633449 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f3cc7813-f672-4798-a0b4-f138c9860249 req-1e264bc9-c5b4-4996-a4d3-5998ad0a50b1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:12.633886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-f3cc7813-f672-4798-a0b4-f138c9860249 req-1e264bc9-c5b4-4996-a4d3-5998ad0a50b1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:12.645084 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-f3cc7813-f672-4798-a0b4-f138c9860249 req-1e264bc9-c5b4-4996-a4d3-5998ad0a50b1 service nova] Creating event network-changed:3ebe6817-897a-4bd5-8e3d-f0a6e9a8b050 for instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 on hv-cinder-85200 Sep 11 00:11:12.650159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-f3cc7813-f672-4798-a0b4-f138c9860249 req-1e264bc9-c5b4-4996-a4d3-5998ad0a50b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032023 Sep 11 00:11:12.650958 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 498/998] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:11:12.887262 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:12.887881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:12.889857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:11:12.894573 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:12.900371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:12.900371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:12.900371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:12.900371 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:12.900930 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:13.073094 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:13.081028 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ed0cebc7-87de-4cf6-8f6b-72f96b598613 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.197699 Sep 11 00:11:13.081620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 501/999] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:12 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:13.485882 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:13.486582 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:13.493395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:13.493882 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:13.494324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:13.496176 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:13.496637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:13.497070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:13.636218 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:13.643987 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-81dcb28f-01c6-4a33-a724-22ce5b2d54a8 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.162420 Sep 11 00:11:13.653007 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 499/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:13 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:14.104683 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:14.105280 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:14.111699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:14.112181 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:14.112618 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:14.113364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:14.113752 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:14.114189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:14.133306 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:11:14.245708 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:14.253326 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c1b00a2f-5a59-4543-99cc-4db66c6b220d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.152586 Sep 11 00:11:14.253885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 502/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:14 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:14.668522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:14.669118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:14.675629 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:14.676100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:14.676524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:14.677834 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:14.678276 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:14.678748 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:14.808251 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:14.816012 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a0b83e88-eae4-4a70-99ba-74ce110eb6fa tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.151370 Sep 11 00:11:14.816638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 500/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:14 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:15.276641 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:15.277256 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:15.284553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:15.285040 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:15.285480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:15.286851 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:15.287393 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:15.287884 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:15.419511 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:15.427780 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c307626e-7f3f-4dca-8f4b-49cc08704314 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.155013 Sep 11 00:11:15.428339 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 503/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:15 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:15.840081 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:15.840696 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:15.843166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:11:15.847879 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:15.848366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:15.849894 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:15.850605 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:15.851087 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:15.851508 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:15.990207 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:16.000065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-35078510-021d-4aa4-a82d-dd90439f8441 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.163664 Sep 11 00:11:16.000937 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 501/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:15 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:16.003984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-1b627937-ebc8-4a3c-ab96-fc7e00fe7ba8 req-52d58079-69dd-4b9a-9e28-932f3f10b323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902ccc1c-f002-4a8a-aa95-f84cea72606a", "name": "network-vif-plugged", "status": "completed", "tag": "b6f168ce-ddb7-4058-81ef-2684d1f44a39"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:11:16.014736 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-1b627937-ebc8-4a3c-ab96-fc7e00fe7ba8 req-52d58079-69dd-4b9a-9e28-932f3f10b323 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:16.015283 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-1b627937-ebc8-4a3c-ab96-fc7e00fe7ba8 req-52d58079-69dd-4b9a-9e28-932f3f10b323 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:16.015794 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-1b627937-ebc8-4a3c-ab96-fc7e00fe7ba8 req-52d58079-69dd-4b9a-9e28-932f3f10b323 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:16.027505 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-1b627937-ebc8-4a3c-ab96-fc7e00fe7ba8 req-52d58079-69dd-4b9a-9e28-932f3f10b323 service nova] Creating event network-vif-plugged:b6f168ce-ddb7-4058-81ef-2684d1f44a39 for instance 902ccc1c-f002-4a8a-aa95-f84cea72606a on hv-cinder-85200 Sep 11 00:11:16.032762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-1b627937-ebc8-4a3c-ab96-fc7e00fe7ba8 req-52d58079-69dd-4b9a-9e28-932f3f10b323 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Sep 11 00:11:16.033600 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 504/1005] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:11:16.449495 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:16.450104 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:16.456303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:16.457155 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:16.457373 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:16.458569 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:16.459040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:16.459452 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:16.589165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:16.596662 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9f0c1709-cb73-4439-a1d6-3e14b27ca281 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.151217 Sep 11 00:11:16.597222 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 502/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:16 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:17.026296 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:17.027018 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:17.033323 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:17.033797 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:17.034227 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:17.034919 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:17.035364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:17.035779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:17.124154 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:11:17.143669 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=6 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:11:17.169283 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:17.177155 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e533580a-8a02-4013-a88b-73dbb171ac82 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1577 microversion: 2.1 time: 0.155437 Sep 11 00:11:17.177727 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 505/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:17 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:17.619889 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:17.620486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:17.622829 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=6 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:11:17.627554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:17.628028 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:17.628459 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:17.629134 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:17.629576 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:17.630844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:17.763199 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:17.770841 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-305c62af-bef5-43e7-8adc-248819490fd0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.154906 Sep 11 00:11:17.771405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 503/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:17 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:11:18.201207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:18.201853 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:18.209359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:18.209850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:18.210286 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:18.211009 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:18.212105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:18.212552 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:18.348368 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:18.357086 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c6be7e38-0a05-4824-a262-49afab1c6431 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1564 microversion: 2.1 time: 0.160131 Sep 11 00:11:18.362248 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 506/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:18 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:18.793297 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:18.793936 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:18.800349 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:18.800822 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:18.801254 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:18.801989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:18.802431 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:18.802886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:18.937751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:18.946059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4390474a-ada9-41ca-92fc-5e9f9cf8d83d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.156660 Sep 11 00:11:18.946616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 504/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:18 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:19.969413 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:19.970016 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:19.977211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:19.977679 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:19.978148 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:19.978887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:19.979332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:19.979744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:20.112149 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:20.113508 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-36776635-7e94-4320-906d-98ae89b325ae req-9643e5e6-788e-4255-8389-dd3135e08e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6cdb29e-dcca-4d50-adf7-2be2674c36d8", "name": "network-vif-plugged", "status": "completed", "tag": "3ebe6817-897a-4bd5-8e3d-f0a6e9a8b050"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:11:20.120943 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-52004b72-5f71-45f9-9768-8ab4236b8da9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.155424 Sep 11 00:11:20.121647 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 507/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:19 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:20.123752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-36776635-7e94-4320-906d-98ae89b325ae req-9643e5e6-788e-4255-8389-dd3135e08e1c service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:20.126050 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-36776635-7e94-4320-906d-98ae89b325ae req-9643e5e6-788e-4255-8389-dd3135e08e1c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:20.126050 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-36776635-7e94-4320-906d-98ae89b325ae req-9643e5e6-788e-4255-8389-dd3135e08e1c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:20.128469 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:11:20.136072 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-36776635-7e94-4320-906d-98ae89b325ae req-9643e5e6-788e-4255-8389-dd3135e08e1c service nova] Creating event network-vif-plugged:3ebe6817-897a-4bd5-8e3d-f0a6e9a8b050 for instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 on hv-cinder-85200 Sep 11 00:11:20.141051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-36776635-7e94-4320-906d-98ae89b325ae req-9643e5e6-788e-4255-8389-dd3135e08e1c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031559 Sep 11 00:11:20.141613 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 505/1012] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:11:21.143277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:21.143815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:21.150815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:21.151290 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:21.151718 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:21.152403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:21.152843 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:21.153255 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:21.282945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:21.291056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-613eec99-0ab7-40f7-9d63-f6edbb8929a7 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1365 microversion: 2.1 time: 0.151702 Sep 11 00:11:21.291639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 508/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:21 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:22.314804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:22.315568 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:22.323485 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:22.324107 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:22.324545 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:22.325242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:22.325695 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:22.326120 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:22.463739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:11:22.471562 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-9af6519a-1c7d-4392-b311-1ced99f184ac tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1554 microversion: 2.1 time: 0.161757 Sep 11 00:11:22.475146 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 506/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:11:22 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:11:22.494768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:11:22.503984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:11:22.503984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:22.503984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:22.503984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:22.504428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:22.504428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:22.504428 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:22.583974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-c6127b78-1c8c-439d-a754-b5bb6c9349a9 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093105 Sep 11 00:11:22.584568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 509/1015] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Sep 11 00:11:22 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:11:23.861213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-d9c1f5a7-244a-4a83-b4c5-24f0ff43b75a req-4b32b066-e087-45cb-af34-3d4f2db4e6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6cdb29e-dcca-4d50-adf7-2be2674c36d8", "tag": "3ebe6817-897a-4bd5-8e3d-f0a6e9a8b050"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:11:23.871453 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-d9c1f5a7-244a-4a83-b4c5-24f0ff43b75a req-4b32b066-e087-45cb-af34-3d4f2db4e6d1 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:11:23.871928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-d9c1f5a7-244a-4a83-b4c5-24f0ff43b75a req-4b32b066-e087-45cb-af34-3d4f2db4e6d1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:11:23.872353 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-d9c1f5a7-244a-4a83-b4c5-24f0ff43b75a req-4b32b066-e087-45cb-af34-3d4f2db4e6d1 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:11:23.884131 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-d9c1f5a7-244a-4a83-b4c5-24f0ff43b75a req-4b32b066-e087-45cb-af34-3d4f2db4e6d1 service nova] Creating event network-changed:3ebe6817-897a-4bd5-8e3d-f0a6e9a8b050 for instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 on hv-cinder-85200 Sep 11 00:11:23.889012 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-d9c1f5a7-244a-4a83-b4c5-24f0ff43b75a req-4b32b066-e087-45cb-af34-3d4f2db4e6d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031772 Sep 11 00:11:23.889906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 507/1016] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:00.074257 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=17 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:00.075074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=38 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:00.079111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:00.080557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:00.086388 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:00.086901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:00.087336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:00.088015 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:00.088463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:00.088876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:00.112347 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6197791c-132f-4828-bec2-bb63e1f5cb64 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/ips" status: 200 len: 149 microversion: 2.1 time: 0.039585 Sep 11 00:12:00.112904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 510/1017] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:12:00 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:01.695920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=13 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:01.696776 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=8 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:01.701227 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fed26a4b-cc63-4e02-89f9-c910cf02b556"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:01.703699 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:01.710579 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:01.711083 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:01.711515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:01.712201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:01.712651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:01.713072 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:02.448637 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0c2fc15f-e1dd-4b28-a74e-048e1eb84567 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754879 Sep 11 00:12:02.449250 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 508/1018] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:12:01 2022] POST /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:08.927867 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:08.928404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:08.935359 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:08.935839 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:08.936275 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:08.936955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:08.937406 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:08.937831 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:08.962953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:12:09.290915 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d5d87e76-fe66-4bf0-91a9-04afa0afce1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 204 len: 0 microversion: 2.1 time: 0.367177 Sep 11 00:12:09.291500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 511/1019] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:12:08 2022] DELETE /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:12:09.301040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:09.301860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:09.308988 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:09.308988 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:09.309415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:09.310128 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:09.310574 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:09.311019 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:09.444477 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:09.452793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c19e2f9b-e2e0-4f02-aa5a-b927ab8b891f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1577 microversion: 2.1 time: 0.156724 Sep 11 00:12:09.453355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 509/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:09 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:10.477435 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:10.477999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:10.484469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:10.484951 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:10.485402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:10.486063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:10.486511 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:10.486961 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:10.622166 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:10.629909 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-88fe0e04-3654-423c-86f2-7523d13dd823 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1577 microversion: 2.1 time: 0.157626 Sep 11 00:12:10.630468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 512/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:10 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:11.654209 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:11.655174 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:11.661434 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:11.662116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:11.662555 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:11.663290 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:11.663740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:11.664766 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:11.798909 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:11.809498 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b37e40a2-bbdf-43e5-b355-7caf3731724b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1577 microversion: 2.1 time: 0.159177 Sep 11 00:12:11.810458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 510/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:11 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:12.112969 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fed26a4b-cc63-4e02-89f9-c910cf02b556"}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:12.115432 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:12.122234 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.122970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.123382 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.124152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.124665 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.125225 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.205385 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Invalid volume: volume fed26a4b-cc63-4e02-89f9-c910cf02b556 is already attached to instances: b6cdb29e-dcca-4d50-adf7-2be2674c36d8 Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: POST /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments HTTP/1.1 Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 74 Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:12:12.207210 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {"volumeAttachment": {"volumeId": "fed26a4b-cc63-4e02-89f9-c910cf02b556"}} Sep 11 00:12:12.208652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Invalid volume: volume fed26a4b-cc63-4e02-89f9-c910cf02b556 is already attached to instances: b6cdb29e-dcca-4d50-adf7-2be2674c36d8 Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'server_id': 'b6cdb29e-dcca-4d50-adf7-2be2674c36d8', 'body': {'volumeAttachment': {'volumeId': 'fed26a4b-cc63-4e02-89f9-c910cf02b556'}}} Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fed26a4b-cc63-4e02-89f9-c910cf02b556 is already attached to instances: b6cdb29e-dcca-4d50-adf7-2be2674c36d8 Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:12.209779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fed26a4b-cc63-4e02-89f9-c910cf02b556 is already attached to instances: b6cdb29e-dcca-4d50-adf7-2be2674c36d8 Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:12.211152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:12:12.212672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:12:12.212672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:12:12.212672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:12:12.212672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fed26a4b-cc63-4e02-89f9-c910cf02b556 is already attached to instances: b6cdb29e-dcca-4d50-adf7-2be2674c36d8 Sep 11 00:12:12.212672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:12.212672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 400 to user: Invalid volume: volume fed26a4b-cc63-4e02-89f9-c910cf02b556 is already attached to instances: b6cdb29e-dcca-4d50-adf7-2be2674c36d8 {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:12:12.212672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-05f26ba7-b020-4544-8cd4-9300d89563ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099766 Sep 11 00:12:12.212672 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 513/1023] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:12:12 2022] POST /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:12:12.278579 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:12.279392 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:12.285788 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.286303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.286763 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.287456 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.288056 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.288476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.375003 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lazy-loading 'services' on Instance uuid b6cdb29e-dcca-4d50-adf7-2be2674c36d8 {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:12:12.578242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d1b9ed7e-bf73-4cb7-b6cc-71ba82cc4838 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments/fed26a4b-cc63-4e02-89f9-c910cf02b556" status: 202 len: 0 microversion: 2.1 time: 0.303333 Sep 11 00:12:12.578884 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 511/1024] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:12:12 2022] DELETE /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments/fed26a4b-cc63-4e02-89f9-c910cf02b556 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:12:12.589431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:12.591756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:12.598832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.599322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.599953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.600659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.601165 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.602517 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.638055 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8e84e715-b91f-4407-bf01-4da3521b553d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053882 Sep 11 00:12:12.638305 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 514/1025] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:12:12 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:12.834917 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-98b9eecc-3800-4df9-b8fb-4f298b8b6654 req-723d60fd-c60a-4e2b-af2e-d360475552f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba7a8eb-372f-4d28-8f68-547e780658a5", "name": "network-vif-deleted", "tag": "20576cc6-0405-423f-95c0-6a0de1b74926"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:12.835488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:12.837837 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:12.844747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.845634 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.846288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.847317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.848516 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.849557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.853500 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-98b9eecc-3800-4df9-b8fb-4f298b8b6654 req-723d60fd-c60a-4e2b-af2e-d360475552f7 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:12.854030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-98b9eecc-3800-4df9-b8fb-4f298b8b6654 req-723d60fd-c60a-4e2b-af2e-d360475552f7 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:12.854415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-98b9eecc-3800-4df9-b8fb-4f298b8b6654 req-723d60fd-c60a-4e2b-af2e-d360475552f7 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:12.877314 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-98b9eecc-3800-4df9-b8fb-4f298b8b6654 req-723d60fd-c60a-4e2b-af2e-d360475552f7 service nova] Creating event network-vif-deleted:20576cc6-0405-423f-95c0-6a0de1b74926 for instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 on hv-cinder-85200 Sep 11 00:12:12.902906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-98b9eecc-3800-4df9-b8fb-4f298b8b6654 req-723d60fd-c60a-4e2b-af2e-d360475552f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142030 Sep 11 00:12:12.903820 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 512/1026] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:12.931844 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:12.940331 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9f934d2f-df2a-47d4-a211-21acee3678fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1510 microversion: 2.1 time: 0.110018 Sep 11 00:12:12.941545 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 515/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:12 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1510 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:13.650275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:13.652739 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:13.659838 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:13.660343 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:13.660778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:13.661479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:13.662014 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:13.662438 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:13.696962 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-e1eba162-42b4-4530-a0b2-6cb5611f7881 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051248 Sep 11 00:12:13.697529 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 513/1028] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:12:13 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:13.964336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:13.964982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:13.971419 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:13.971900 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:13.972324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:13.973007 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:13.973449 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:13.973856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:14.006858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:14.007341 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:14.008567 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:14.009091 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lazy-loading 'fault' on Instance uuid 3ba7a8eb-372f-4d28-8f68-547e780658a5 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:12:14.052539 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:14.061404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ea0b386d-96fc-47aa-8399-180897019b60 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 200 len: 1230 microversion: 2.1 time: 0.100934 Sep 11 00:12:14.061973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 516/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:13 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:14.709588 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:14.712491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:14.719675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:14.720379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:14.720823 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:14.721551 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:14.722297 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:14.722749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:14.755039 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-27fc2bc6-19d2-4d59-ab04-c368015bb039 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049727 Sep 11 00:12:14.755602 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 514/1030] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:12:14 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:12:14.819816 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:14.820466 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:14.827291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:14.827812 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:14.828251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:14.828944 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:14.829400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:14.829825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:14.856783 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:12:15.085374 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:15.086633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:15.092478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:15.092943 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:15.093366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:15.094034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:15.094476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:15.094913 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:15.099117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1f368173-f5f2-4b2d-a90f-84c425f9cce2 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 204 len: 0 microversion: 2.1 time: 0.282771 Sep 11 00:12:15.099740 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 517/1031] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:12:14 2022] DELETE /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:12:15.108481 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:15.109183 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:15.109959 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] HTTP exception thrown: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Request method failure captured: Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 HTTP/1.1 Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHScv7ZFT1SnGrjDI2PY0xZVpQwJgL6f66NFIVzkEsgalpf6mTh8hxGyn6Sd85a80ITe6EUsEL81gpl6OCzp757262hpPawwWZcZg_vhmTdCKr8eUpWlwB_ElJqigSoh8ZMXz5Fiubb_XyD5Z1lQYzfE-x6sUi6p3PzFWBK0w1tutaAM Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:12:15.111828 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a819c981f44e4d21ab8b8289d16c19fb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}] Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: aa4f534ee1ab4e639e99b9e4ebbe8363 Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:12:15.113410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '3ba7a8eb-372f-4d28-8f68-547e780658a5'} Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:12:15.114256 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:12:15.115950 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:12:15.117844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Returning 404 to user: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:12:15.117844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-6a2e1d7b-4461-4f7e-aab7-581a3088f490 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 404 len: 111 microversion: 2.1 time: 0.031669 Sep 11 00:12:15.117844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 515/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:15 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 00:12:15.118456 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:15.118456 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:15.118456 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:15.118456 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:15.118908 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:15.118908 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:15.163770 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1942294919", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-280477967", "security_groups": [{"name": "tempest-secgroup-smoke-106989926"}], "block_device_mapping_v2": [{"uuid": "0b6c6496-bb6c-46b1-8dbb-70ff1dc332cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcdda1c5-3ab3-4fad-9f02-121ff2f99084"}]}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:15.256517 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:15.267351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-df1413ed-b860-4ef4-8705-4b7c47a48ace tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1679 microversion: 2.1 time: 0.162857 Sep 11 00:12:15.267939 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 518/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:15 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:15.286210 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] validate_networks() for [('fcdda1c5-3ab3-4fad-9f02-121ff2f99084', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:12:15.661796 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:12:15.662212 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:12:15.662712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:12:15.663120 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:12:15.663525 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:12:15.672659 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:15.673134 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:15.673565 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:15.674281 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:15.674780 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:15.675201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:15.692465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Getting quotas for project a819c981f44e4d21ab8b8289d16c19fb. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:12:15.696824 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Getting quotas for user aa4f534ee1ab4e639e99b9e4ebbe8363 and project a819c981f44e4d21ab8b8289d16c19fb. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:12:15.753311 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:12:15.755544 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b6c6496-bb6c-46b1-8dbb-70ff1dc332cf',volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:12:16.224238 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b0b7797e-eada-4d07-9b61-980ad1ef264b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.064392 Sep 11 00:12:16.224876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 516/1034] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:12:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 00:12:16.236432 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-21242a24-2353-4092-bfb2-28e12c48b6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:16.237069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-21242a24-2353-4092-bfb2-28e12c48b6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:16.296083 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:16.297093 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:16.306401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-21242a24-2353-4092-bfb2-28e12c48b6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:16.314915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:16.315548 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:16.316082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:16.316788 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-21242a24-2353-4092-bfb2-28e12c48b6e0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1094 microversion: 2.1 time: 0.084187 Sep 11 00:12:16.316952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:16.317902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:16.318430 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 519/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:16 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:16.318794 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:16.474038 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:16.482355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-041569eb-5987-45ca-90f1-c331aaea5231 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1679 microversion: 2.1 time: 0.190875 Sep 11 00:12:16.482952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 517/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:16 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:17.342596 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:17.343313 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:17.358361 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:17.359097 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:17.359716 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:17.360605 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:17.361202 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:17.361783 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:17.439213 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:17.449246 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-678f1410-78b6-4829-9b27-f0c9873f9f79 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1144 microversion: 2.1 time: 0.111618 Sep 11 00:12:17.449825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 520/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:17 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1144 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:17.505952 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:17.506564 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:17.513746 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:17.514238 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:17.515337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:17.516080 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:17.516541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:17.516967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:17.653647 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:17.662069 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-441e616d-fd4c-483c-b5fa-ceff13e39c8c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1679 microversion: 2.1 time: 0.160324 Sep 11 00:12:17.662735 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 518/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:17 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:18.123961 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-0d32384a-ac04-4dad-9f0d-ad6d2a63a390 req-4280fb35-d76d-4d6e-a171-5ae528f5e097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6cdb29e-dcca-4d50-adf7-2be2674c36d8", "name": "network-vif-deleted", "tag": "3ebe6817-897a-4bd5-8e3d-f0a6e9a8b050"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:18.133670 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-0d32384a-ac04-4dad-9f0d-ad6d2a63a390 req-4280fb35-d76d-4d6e-a171-5ae528f5e097 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:18.134242 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-0d32384a-ac04-4dad-9f0d-ad6d2a63a390 req-4280fb35-d76d-4d6e-a171-5ae528f5e097 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:18.134685 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-0d32384a-ac04-4dad-9f0d-ad6d2a63a390 req-4280fb35-d76d-4d6e-a171-5ae528f5e097 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:18.146400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-0d32384a-ac04-4dad-9f0d-ad6d2a63a390 req-4280fb35-d76d-4d6e-a171-5ae528f5e097 service nova] Creating event network-vif-deleted:3ebe6817-897a-4bd5-8e3d-f0a6e9a8b050 for instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 on hv-cinder-85200 Sep 11 00:12:18.151778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-0d32384a-ac04-4dad-9f0d-ad6d2a63a390 req-4280fb35-d76d-4d6e-a171-5ae528f5e097 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031894 Sep 11 00:12:18.152366 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 521/1039] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:12:18.473382 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:18.474046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:18.481050 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:18.481543 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:18.481983 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:18.482705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:18.483163 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:18.483585 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:18.563692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:18.572730 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7e46f15e-c3ef-4d77-9110-525fe9935efa tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1192 microversion: 2.1 time: 0.103109 Sep 11 00:12:18.578028 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 519/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:18 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:18.688705 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:18.689531 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:18.710392 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:18.711530 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:18.711973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:18.712668 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:18.713303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:18.713880 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:18.749789 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:18.750567 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:18.751019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:18.751461 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lazy-loading 'fault' on Instance uuid b6cdb29e-dcca-4d50-adf7-2be2674c36d8 {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:12:18.806281 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:18.815858 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b9b84ec8-4a84-4b95-b2b5-4db5a2fce6a1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 200 len: 1330 microversion: 2.1 time: 0.133849 Sep 11 00:12:18.822607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 522/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:18 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 1330 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:19.609670 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:19.610928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:19.621639 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:19.622686 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:19.623903 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:19.625168 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:19.625849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:19.626455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:19.777895 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:19.785494 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-2164ea0a-2f5f-458c-8fb9-a3e5f60bf0dd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1277 microversion: 2.1 time: 0.187982 Sep 11 00:12:19.793587 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 520/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:19 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:19.845527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:19.846150 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:19.852910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:19.853390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:19.853821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:19.854518 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:19.855004 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:19.855438 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:19.869418 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 HTTP/1.1 Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:12:19.871271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:12:19.872988 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'b6cdb29e-dcca-4d50-adf7-2be2674c36d8'} Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:12:19.873949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:12:19.875606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:19.877034 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:12:19.877034 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a3e70f8e-107b-4c2e-a9e4-2865ae22adc3 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 404 len: 111 microversion: 2.1 time: 0.031174 Sep 11 00:12:19.877034 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 523/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:19 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:12:19.886540 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-da149e97-7040-4d4b-82c9-6237463e1875 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '.version_select at 0x7f5ab670ae50>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:19.963264 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-da149e97-7040-4d4b-82c9-6237463e1875 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436297842" status: 202 len: 0 microversion: 2.1 time: 0.081162 Sep 11 00:12:19.963850 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 521/1044] 10.222.0.17 () {58 vars in 1218 bytes} [Sun Sep 11 00:12:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436297842 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:12:20.809519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:20.810378 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:20.820025 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:20.820516 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:20.820984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:20.821960 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:20.822477 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:20.822954 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:20.824758 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1e7aa8db-eb6d-48ca-951b-0ceaab12e14d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: .version_select at 0x7f5ab66d0f70>, body: {"keypair": {"name": "tempest-keypair-1253130247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi6HR3CSgvVBvOnBdDRUvJh7OLWFzNYWNSozqORTYZ8SmErYeibMT2OO/6BXFE6/4/gW/XO8/BSo+MesADmcH2H1Un8z06aFGDIfrhNZyWlEHaFj5EZf/RMvbAFSMbD/A=="}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:20.843391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-1e7aa8db-eb6d-48ca-951b-0ceaab12e14d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:12:20.847437 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-1e7aa8db-eb6d-48ca-951b-0ceaab12e14d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for user 6ae921c806734b0a8218ea7453e8bd4e and project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'key_pairs'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:12:20.943255 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1e7aa8db-eb6d-48ca-951b-0ceaab12e14d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122400 Sep 11 00:12:20.944048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 522/1045] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Sep 11 00:12:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:12:20.955651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-14e3b2b8-7605-4763-b9b7-bbbe4359fd76 req-511ee358-8254-4f2c-8efb-bc90c66b381a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fb3b0e-0f52-4322-8416-2c1407d1a73d", "tag": "6b78e9e6-43d4-4917-b6ae-8796aad5b368"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:20.967524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-14e3b2b8-7605-4763-b9b7-bbbe4359fd76 req-511ee358-8254-4f2c-8efb-bc90c66b381a service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:20.973223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-14e3b2b8-7605-4763-b9b7-bbbe4359fd76 req-511ee358-8254-4f2c-8efb-bc90c66b381a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:20.973223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-14e3b2b8-7605-4763-b9b7-bbbe4359fd76 req-511ee358-8254-4f2c-8efb-bc90c66b381a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:20.980931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-14e3b2b8-7605-4763-b9b7-bbbe4359fd76 req-511ee358-8254-4f2c-8efb-bc90c66b381a service nova] Creating event network-changed:6b78e9e6-43d4-4917-b6ae-8796aad5b368 for instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d on hv-cinder-85200 Sep 11 00:12:20.985991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-14e3b2b8-7605-4763-b9b7-bbbe4359fd76 req-511ee358-8254-4f2c-8efb-bc90c66b381a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034173 Sep 11 00:12:20.986524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 523/1046] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:21.030919 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:21.042053 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-302f5743-3d58-4fd4-95b2-0cbbcd9ed1b2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.233058 Sep 11 00:12:21.042053 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 524/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:20 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:22.063441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:22.064132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:22.071683 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:22.077395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:22.077395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:22.077395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:22.077395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:22.077790 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:22.299940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:22.311887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3da819ab-f86d-43ae-b7af-dfa7e6e142f3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.252516 Sep 11 00:12:22.312482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 524/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:22 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:23.100992 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1029223111", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "703dcb23-f6c5-48ec-90e6-3c57db88c851"}], "security_groups": [{"name": "tempest-securitygroup--1773127574"}], "key_name": "tempest-keypair-1253130247", "user_data": "}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:23.206012 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] validate_networks() for [('703dcb23-f6c5-48ec-90e6-3c57db88c851', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:12:23.335780 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:23.336737 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:23.343694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:23.344152 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:23.344614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:23.345304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:23.345748 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:23.346164 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:23.481191 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:23.488930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-06647b62-1b02-427e-9b04-8ba04fe7e9bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.157077 Sep 11 00:12:23.489686 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 525/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:23 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:23.647345 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:12:23.647770 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:12:23.648880 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:12:23.649289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:12:23.649697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:12:23.658465 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:23.658969 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:23.659401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:23.660142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:23.660589 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:23.661007 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:23.668323 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:23.678552 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:12:23.682516 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Getting quotas for user 6ae921c806734b0a8218ea7453e8bd4e and project 261177a9929f4df4bff1d0c009b1b3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:12:23.693394 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:12:23.695731 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:12:23.838368 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a72fb434-c0c7-4b09-8846-95522558ef1b tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.741752 Sep 11 00:12:23.839073 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 525/1050] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:12:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:12:23.850314 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7b123ebd-60dc-42bd-83c1-11861fd85dba tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:23.851918 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7b123ebd-60dc-42bd-83c1-11861fd85dba tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:23.904085 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7b123ebd-60dc-42bd-83c1-11861fd85dba tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:23.911208 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7b123ebd-60dc-42bd-83c1-11861fd85dba tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1242 microversion: 2.1 time: 0.064737 Sep 11 00:12:23.911767 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 526/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:23 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:24.512994 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:24.513615 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:24.519717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:24.520198 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:24.520633 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:24.521317 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:24.521769 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:24.522186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:24.662268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:24.671067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d2993a76-692c-47c0-876c-079af42deeac tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.163295 Sep 11 00:12:24.672057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 526/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:24 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:24.938168 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:24.938989 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:24.945853 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:24.946345 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:24.946776 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:24.947475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:24.947920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:24.948340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:25.013073 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:25.020713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-57f08416-b10b-4e95-9bc9-965fe3145d95 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1246 microversion: 2.1 time: 0.090753 Sep 11 00:12:25.021279 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 527/1053] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:24 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:25.694820 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:25.695801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:25.702804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:25.703391 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:25.704082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:25.704812 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:25.705533 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:25.705960 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:25.837479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:25.845205 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ab6b32a9-c0be-4815-a8cf-870480727928 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.154357 Sep 11 00:12:25.845770 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 527/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:25 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:26.044797 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:26.045504 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:26.047486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:26.052701 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:26.053179 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:26.053614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:26.054303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:26.054787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:26.055404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:26.059318 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:26.118159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:26.125769 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-eab2d4b3-c0b0-4969-b960-18cf42360ed5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1294 microversion: 2.1 time: 0.084850 Sep 11 00:12:26.126340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 528/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:26 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:26.869876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:26.871108 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:26.877096 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:26.877574 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:26.877999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:26.878722 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:26.879142 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:26.879556 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:27.068993 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:27.079320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-0571fbb4-a332-416c-95e2-5076530a33c3 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.213784 Sep 11 00:12:27.079901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 528/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:26 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:27.148727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:27.149397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:27.156741 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:27.157157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:27.157599 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:27.158287 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:27.158764 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:27.159263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:27.326820 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:27.337319 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f447c5ea-1830-4725-98d0-9badebc40bf5 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1368 microversion: 2.1 time: 0.192740 Sep 11 00:12:27.338555 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 529/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:27 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:28.104450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:28.105196 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:28.111208 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:28.111769 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:28.112207 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:28.112898 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:28.113348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:28.113772 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:28.320489 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:28.328496 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-e01022c7-1e87-4fee-be50-5c82038a64c2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.229453 Sep 11 00:12:28.329058 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 529/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:28 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:28.364234 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:28.364974 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:28.372364 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:28.372931 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:28.373441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:28.374209 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:28.374782 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:28.375284 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:28.508280 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:28.516455 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-feb5b108-cfe2-486f-84fa-946cb6a7bb8d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1368 microversion: 2.1 time: 0.156117 Sep 11 00:12:28.517334 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 530/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:28 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:28.847729 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-21ee7bba-c0e3-4e30-b2ad-fc32cbddd5a2 req-9c013cd5-df59-4e49-8d71-9c2c9e747376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e2202d-5c60-4b83-be99-f1a1e69f1ecd", "tag": "2ebb210c-ac78-4dde-9dd8-0db65e95ff10"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:28.857410 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-21ee7bba-c0e3-4e30-b2ad-fc32cbddd5a2 req-9c013cd5-df59-4e49-8d71-9c2c9e747376 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:28.857888 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-21ee7bba-c0e3-4e30-b2ad-fc32cbddd5a2 req-9c013cd5-df59-4e49-8d71-9c2c9e747376 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:28.858324 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-21ee7bba-c0e3-4e30-b2ad-fc32cbddd5a2 req-9c013cd5-df59-4e49-8d71-9c2c9e747376 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:28.870963 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-21ee7bba-c0e3-4e30-b2ad-fc32cbddd5a2 req-9c013cd5-df59-4e49-8d71-9c2c9e747376 service nova] Creating event network-changed:2ebb210c-ac78-4dde-9dd8-0db65e95ff10 for instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd on hv-cinder-85200 Sep 11 00:12:28.876022 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-21ee7bba-c0e3-4e30-b2ad-fc32cbddd5a2 req-9c013cd5-df59-4e49-8d71-9c2c9e747376 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Sep 11 00:12:28.881678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 530/1060] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:12:29.352858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:29.353385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:29.359394 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:29.359891 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:29.360323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:29.361021 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:29.361472 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:29.361897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:29.529267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:29.537393 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d4b80fe5-d0d7-4c84-995a-2d238415c044 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.189030 Sep 11 00:12:29.538153 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 531/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:29 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:29.542486 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:29.543211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:29.549904 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:29.550387 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:29.550854 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:29.551663 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:29.552173 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:29.552637 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:29.751949 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:29.762875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b0818739-014c-4270-8330-8108425f518e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1368 microversion: 2.1 time: 0.226388 Sep 11 00:12:29.763910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 531/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:29 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:30.562074 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:30.562769 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:30.571317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:30.571798 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:30.572232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:30.572920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:30.573362 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:30.573908 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:30.714539 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:30.722466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ff1bb257-a876-41f8-b78f-6146099a3917 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.165357 Sep 11 00:12:30.723059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 532/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:30 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:30.790404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:30.791043 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:30.797626 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:30.798099 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:30.798828 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:30.799628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:30.800111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:30.800545 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:30.965459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:30.974935 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b238c2ae-7d98-43ed-a145-fbcc46720687 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1368 microversion: 2.1 time: 0.189693 Sep 11 00:12:30.977713 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 532/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:30 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:31.745243 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:31.745878 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:31.752264 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:31.752734 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:31.753161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:31.753834 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:31.754276 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:31.754721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:31.888654 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:31.896329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0e52f85f-36b0-4c5a-80a4-ceca5b0310e8 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.154968 Sep 11 00:12:31.896886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 533/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:31 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:32.000327 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:32.000852 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:32.007233 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:32.007713 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:32.008153 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:32.009540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:32.010303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:32.010756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:32.141103 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:32.148874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2d0f0fa9-c0a3-4a27-b63b-fa2ec1925d5d tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1368 microversion: 2.1 time: 0.152437 Sep 11 00:12:32.149444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 533/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:31 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:32.739806 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-dbc3ecaa-edf1-47a3-8c9c-b342507630ed req-a37085b2-b053-4c8f-920a-7da316b9423a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb3b0e-0f52-4322-8416-2c1407d1a73d", "name": "network-vif-plugged", "status": "completed", "tag": "6b78e9e6-43d4-4917-b6ae-8796aad5b368"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:32.744642 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:32.750096 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-dbc3ecaa-edf1-47a3-8c9c-b342507630ed req-a37085b2-b053-4c8f-920a-7da316b9423a service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:32.750719 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-dbc3ecaa-edf1-47a3-8c9c-b342507630ed req-a37085b2-b053-4c8f-920a-7da316b9423a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:32.755978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-dbc3ecaa-edf1-47a3-8c9c-b342507630ed req-a37085b2-b053-4c8f-920a-7da316b9423a service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:32.761536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-dbc3ecaa-edf1-47a3-8c9c-b342507630ed req-a37085b2-b053-4c8f-920a-7da316b9423a service nova] Creating event network-vif-plugged:6b78e9e6-43d4-4917-b6ae-8796aad5b368 for instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d on hv-cinder-85200 Sep 11 00:12:32.766458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-dbc3ecaa-edf1-47a3-8c9c-b342507630ed req-a37085b2-b053-4c8f-920a-7da316b9423a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083884 Sep 11 00:12:32.767066 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 534/1067] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:32.919875 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:32.920478 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:32.926552 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:32.927063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:32.927767 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:32.928473 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:32.928917 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:32.929337 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:33.072591 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:33.080751 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-837276af-b7c6-4461-b451-85c2d8918cf7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.164407 Sep 11 00:12:33.081356 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 534/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:32 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:33.172595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:33.173423 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:33.179976 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:33.180458 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:33.180897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:33.181592 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:33.182046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:33.182470 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:33.313341 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:33.321712 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-eeb7c081-0e06-4c55-9d35-4e94e932ca6f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1368 microversion: 2.1 time: 0.153796 Sep 11 00:12:33.322291 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 535/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:33 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:34.104897 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:34.105509 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:34.107460 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:34.108218 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=8 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:34.113323 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:34.113804 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:34.114240 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:34.114955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:34.115402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:34.115823 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:34.252878 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:34.260448 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-fc769e1b-0e6f-4dfa-a928-0ad5dbb2a9a6 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1265 microversion: 2.1 time: 0.160311 Sep 11 00:12:34.261007 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 535/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:34 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:34.345598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:34.346216 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:34.348643 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=12 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:34.354778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:34.355268 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:34.355703 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:34.356398 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:34.356847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:34.357265 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:34.492190 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:34.499911 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8ed62423-2702-4843-919f-4c14511f51ab tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1368 microversion: 2.1 time: 0.158315 Sep 11 00:12:34.500476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 536/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:34 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:34.781916 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-8835a57e-c01d-40ac-9500-8a2dcb43dea5 req-d11573b0-dad7-4a69-b961-9226d7397d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e2202d-5c60-4b83-be99-f1a1e69f1ecd", "name": "network-vif-plugged", "status": "completed", "tag": "2ebb210c-ac78-4dde-9dd8-0db65e95ff10"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:34.791357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-8835a57e-c01d-40ac-9500-8a2dcb43dea5 req-d11573b0-dad7-4a69-b961-9226d7397d34 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:34.791832 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-8835a57e-c01d-40ac-9500-8a2dcb43dea5 req-d11573b0-dad7-4a69-b961-9226d7397d34 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:34.792259 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-8835a57e-c01d-40ac-9500-8a2dcb43dea5 req-d11573b0-dad7-4a69-b961-9226d7397d34 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:34.802842 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-8835a57e-c01d-40ac-9500-8a2dcb43dea5 req-d11573b0-dad7-4a69-b961-9226d7397d34 service nova] Creating event network-vif-plugged:2ebb210c-ac78-4dde-9dd8-0db65e95ff10 for instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd on hv-cinder-85200 Sep 11 00:12:34.807876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-8835a57e-c01d-40ac-9500-8a2dcb43dea5 req-d11573b0-dad7-4a69-b961-9226d7397d34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029673 Sep 11 00:12:34.808444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 536/1072] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:35.283497 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:35.284111 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:35.290772 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:35.291178 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:35.291636 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:35.292326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:35.292780 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:35.293209 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:35.421882 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:35.430263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-480a7d80-1633-4617-9968-c5c2f98dae3f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1453 microversion: 2.1 time: 0.150625 Sep 11 00:12:35.430849 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 537/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:35 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:35.452913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:35.453610 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:35.459953 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:35.460429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:35.461178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:35.461873 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:35.462328 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:35.462779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:35.523669 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:35.524376 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:35.530217 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:35.530732 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:35.531177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:35.531868 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:35.532317 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:35.532740 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:35.600300 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:35.609050 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-03f0bfd6-9bf2-49ed-b44b-b0d536239338 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1453 microversion: 2.1 time: 0.160706 Sep 11 00:12:35.609598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 537/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:35 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:35.742136 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:35.750283 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fa666525-5d73-4003-b6fb-ebea768bbad0 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1368 microversion: 2.1 time: 0.231110 Sep 11 00:12:35.750928 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 538/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:35 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:36.775721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:36.776370 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:36.783684 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:36.784169 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:36.784607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:36.785322 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:36.785759 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:36.786308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:36.967874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:36.975608 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4578f183-7c28-4ded-850f-ff934bac0378 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1558 microversion: 2.1 time: 0.205466 Sep 11 00:12:36.976218 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 538/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:36 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1558 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:36.998757 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:36.999290 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:37.005302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:37.005774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:37.013011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:37.013011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:37.013011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:37.013011 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:37.141380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fce5ddaa-c492-47d0-8158-bc1133b5ad20 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145759 Sep 11 00:12:37.142086 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 539/1077] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Sep 11 00:12:36 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:38.184401 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:38.184938 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:38.194482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:38.195221 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:38.195973 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:38.197305 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:38.197773 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:38.198348 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:38.238192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:12:38.248197 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-0c4b646a-00b1-4325-8325-3e6c711b63bc req-1728240d-27d8-4014-940f-84c03487b358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902ccc1c-f002-4a8a-aa95-f84cea72606a", "tag": "b6f168ce-ddb7-4058-81ef-2684d1f44a39"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:38.264166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-0c4b646a-00b1-4325-8325-3e6c711b63bc req-1728240d-27d8-4014-940f-84c03487b358 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:38.266129 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-0c4b646a-00b1-4325-8325-3e6c711b63bc req-1728240d-27d8-4014-940f-84c03487b358 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:38.266798 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-0c4b646a-00b1-4325-8325-3e6c711b63bc req-1728240d-27d8-4014-940f-84c03487b358 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:38.281235 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-0c4b646a-00b1-4325-8325-3e6c711b63bc req-1728240d-27d8-4014-940f-84c03487b358 service nova] Creating event network-changed:b6f168ce-ddb7-4058-81ef-2684d1f44a39 for instance 902ccc1c-f002-4a8a-aa95-f84cea72606a on hv-cinder-85200 Sep 11 00:12:38.287787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-0c4b646a-00b1-4325-8325-3e6c711b63bc req-1728240d-27d8-4014-940f-84c03487b358 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110631 Sep 11 00:12:38.289310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 540/1078] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:38.488742 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-094f568f-ab72-46a2-86fe-40ca772519a6 req-ad5bbe94-9426-4235-8e16-d2842db112ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fb3b0e-0f52-4322-8416-2c1407d1a73d", "tag": "6b78e9e6-43d4-4917-b6ae-8796aad5b368"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:38.504306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-094f568f-ab72-46a2-86fe-40ca772519a6 req-ad5bbe94-9426-4235-8e16-d2842db112ff service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:38.507937 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-094f568f-ab72-46a2-86fe-40ca772519a6 req-ad5bbe94-9426-4235-8e16-d2842db112ff service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:38.508501 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-094f568f-ab72-46a2-86fe-40ca772519a6 req-ad5bbe94-9426-4235-8e16-d2842db112ff service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:38.510002 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:38.532826 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-094f568f-ab72-46a2-86fe-40ca772519a6 req-ad5bbe94-9426-4235-8e16-d2842db112ff service nova] Creating event network-changed:6b78e9e6-43d4-4917-b6ae-8796aad5b368 for instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d on hv-cinder-85200 Sep 11 00:12:38.538055 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-094f568f-ab72-46a2-86fe-40ca772519a6 req-ad5bbe94-9426-4235-8e16-d2842db112ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053833 Sep 11 00:12:38.539792 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 541/1079] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:12:38.600251 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-383416eb-5a0a-496b-861a-154e9f041304 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "DELETE /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 204 len: 0 microversion: 2.1 time: 0.424424 Sep 11 00:12:38.605376 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 539/1080] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:12:38 2022] DELETE /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:12:38.611728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:38.612755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:38.621286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:38.622824 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:38.623844 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:38.624803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:38.625493 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:38.626136 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:38.783234 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:38.793234 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-49e12574-9baa-4b3b-848c-562055c4db0a tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.186517 Sep 11 00:12:38.794948 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 542/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:38 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:12:39.821634 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:39.822486 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:39.829937 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:39.831021 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:39.831527 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:39.832301 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:39.832824 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:39.833314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:39.998463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:40.006628 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-71307751-aae0-4b84-b83c-1e639fd2ae89 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1570 microversion: 2.1 time: 0.189445 Sep 11 00:12:40.007279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 540/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:39 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:40.574996 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-340f51fd-908f-46cc-b277-03dbb8cdf35b req-fab857b4-5b62-4f10-99ef-1f7b2d05cca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e2202d-5c60-4b83-be99-f1a1e69f1ecd", "tag": "2ebb210c-ac78-4dde-9dd8-0db65e95ff10"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:40.585934 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-340f51fd-908f-46cc-b277-03dbb8cdf35b req-fab857b4-5b62-4f10-99ef-1f7b2d05cca6 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:40.586529 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-340f51fd-908f-46cc-b277-03dbb8cdf35b req-fab857b4-5b62-4f10-99ef-1f7b2d05cca6 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:40.587030 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-340f51fd-908f-46cc-b277-03dbb8cdf35b req-fab857b4-5b62-4f10-99ef-1f7b2d05cca6 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:40.598606 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-340f51fd-908f-46cc-b277-03dbb8cdf35b req-fab857b4-5b62-4f10-99ef-1f7b2d05cca6 service nova] Creating event network-changed:2ebb210c-ac78-4dde-9dd8-0db65e95ff10 for instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd on hv-cinder-85200 Sep 11 00:12:40.603810 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-340f51fd-908f-46cc-b277-03dbb8cdf35b req-fab857b4-5b62-4f10-99ef-1f7b2d05cca6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032656 Sep 11 00:12:40.604616 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 543/1083] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:41.030073 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:41.031146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:41.037887 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:41.039068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:41.039524 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:41.040211 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:41.040661 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:41.043185 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:41.374593 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:41.382363 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d748c364-3563-4e79-a883-f4087c38c252 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1452 microversion: 2.1 time: 0.356114 Sep 11 00:12:41.383028 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 541/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:41 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1452 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:42.405971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:42.406685 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:42.413424 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:42.413929 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:42.414591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:42.416010 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:42.416473 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:42.416897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:42.481286 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:42.488940 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-082707ec-dbfd-4dbb-9f3b-8075e9932cc2 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1220 microversion: 2.1 time: 0.087266 Sep 11 00:12:42.489499 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 544/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:42 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:42.621352 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-1411d13e-0f58-42a8-b359-3bd041013b6d req-d03f9a97-4900-422c-8fff-be722a5ceeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902ccc1c-f002-4a8a-aa95-f84cea72606a", "name": "network-vif-deleted", "tag": "b6f168ce-ddb7-4058-81ef-2684d1f44a39"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:12:42.631161 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-1411d13e-0f58-42a8-b359-3bd041013b6d req-d03f9a97-4900-422c-8fff-be722a5ceeac service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:42.631631 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-1411d13e-0f58-42a8-b359-3bd041013b6d req-d03f9a97-4900-422c-8fff-be722a5ceeac service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:42.635358 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-1411d13e-0f58-42a8-b359-3bd041013b6d req-d03f9a97-4900-422c-8fff-be722a5ceeac service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:42.636275 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:12:42.643099 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-1411d13e-0f58-42a8-b359-3bd041013b6d req-d03f9a97-4900-422c-8fff-be722a5ceeac service nova] Creating event network-vif-deleted:b6f168ce-ddb7-4058-81ef-2684d1f44a39 for instance 902ccc1c-f002-4a8a-aa95-f84cea72606a on hv-cinder-85200 Sep 11 00:12:42.647686 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-1411d13e-0f58-42a8-b359-3bd041013b6d req-d03f9a97-4900-422c-8fff-be722a5ceeac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030788 Sep 11 00:12:42.648279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 542/1086] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:12:43.513332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:43.513957 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:43.520409 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:43.520888 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:43.521325 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:43.527985 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:43.527985 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:43.527985 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:43.555326 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:43.555941 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:43.556379 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:43.556818 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lazy-loading 'fault' on Instance uuid 902ccc1c-f002-4a8a-aa95-f84cea72606a {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:12:43.598953 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5ea2215fd4c38aabaf375db991d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0d0136b404c68902274c0e571fb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:12:43.607327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-efdbb7bd-b36d-452d-b02c-fda974bf5c27 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 200 len: 1225 microversion: 2.1 time: 0.098239 Sep 11 00:12:43.607979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 545/1087] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:43 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:12:44.631489 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:44.632189 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] [instance: 902ccc1c-f002-4a8a-aa95-f84cea72606a] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:12:44.647792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:44.648265 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:44.649209 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:44.649897 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:12:44.650439 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:12:44.651004 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:12:44.666907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] HTTP exception thrown: Instance 902ccc1c-f002-4a8a-aa95-f84cea72606a could not be found. Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Request method failure captured: Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a HTTP/1.1 Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHSbYqg0KfYFh2emRTWCVAi4bU2BfqUI4Zk1ntHNb3REfLyaZWfpWsQ3fiDA70-LQi545Rk_UXAqFeSJxdBrjozGIv7lpEv_xZd3XdsO9Wjaf3szSsIX0DVHuZLq_cg9k7-8QgdMiZXLT6p-CicGhQGijkq98oSx2Llda5UC5EGnVm20 Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 49b0d0136b404c68902274c0e571fb3a Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-TestShelveInstance-208903198 Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:12:44.668649 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_49b0d0136b404c68902274c0e571fb3a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49b0d0136b404c68902274c0e571fb3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/49b0d0136b404c68902274c0e571fb3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49b0d0136b404c68902274c0e571fb3a"}]}] Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-TestShelveInstance-208903198 Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 49b0d0136b404c68902274c0e571fb3a Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-TestShelveInstance-208903198 Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-TestShelveInstance-208903198-project Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 32b5ea2215fd4c38aabaf375db991d06 Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-TestShelveInstance-208903198-project Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 902ccc1c-f002-4a8a-aa95-f84cea72606a could not be found. Sep 11 00:12:44.670268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '902ccc1c-f002-4a8a-aa95-f84cea72606a'} Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902ccc1c-f002-4a8a-aa95-f84cea72606a could not be found. Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:12:44.671459 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902ccc1c-f002-4a8a-aa95-f84cea72606a could not be found. Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902ccc1c-f002-4a8a-aa95-f84cea72606a could not be found. Sep 11 00:12:44.673067 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:12:44.674675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Returning 404 to user: Instance 902ccc1c-f002-4a8a-aa95-f84cea72606a could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:12:44.674675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-449aef82-68f0-4f23-a12e-a802674b3735 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a" status: 404 len: 111 microversion: 2.1 time: 0.043542 Sep 11 00:12:44.674675 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 543/1088] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:12:44 2022] GET /compute/v2.1/servers/902ccc1c-f002-4a8a-aa95-f84cea72606a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:12:44.912075 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-ad4b04c7-278d-4a92-bb93-a991f68f3371 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] Calling method '.version_select at 0x7f5ab679cca0>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:12:45.026016 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-ad4b04c7-278d-4a92-bb93-a991f68f3371 tempest-TestShelveInstance-208903198 tempest-TestShelveInstance-208903198-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1175751162" status: 202 len: 0 microversion: 2.1 time: 0.117809 Sep 11 00:12:45.026602 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 546/1089] 10.222.0.17 () {58 vars in 1254 bytes} [Sun Sep 11 00:12:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1175751162 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:13:15.065384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:15.065959 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:15.068027 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=8 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:13:15.069090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 00:13:15.069241 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Sun Sep 11 00:13:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/ips (ip 10.222.0.17) !!! Sep 11 00:13:15.077341 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:15.078398 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:15.078869 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:15.079570 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:15.080023 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:15.080448 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:15.104557 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f56fc2b0-28aa-4bcf-9fbd-fbdc50feb205 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/ips" status: 200 len: 150 microversion: 2.1 time: 0.044042 Sep 11 00:13:15.105129 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 544/1090] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Sep 11 00:13:15 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:13:16.706169 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=90 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:13:16.707177 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:13:16.712296 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d95a95a0-0e87-4845-8030-93030ee8921a"}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:13:16.715118 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:16.723304 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:16.723827 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:16.724324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:16.725006 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:16.725459 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:16.725887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:17.495751 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0130ce5c-0bed-4fb6-a580-d4885ff4c19c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "POST /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791622 Sep 11 00:13:17.496352 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 547/1091] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Sep 11 00:13:16 2022] POST /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments => generated 194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:13:25.130341 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:25.130910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:25.133519 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:13:25.138931 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:25.144176 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:25.144176 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:25.144176 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:25.144176 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:25.144580 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:25.223850 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.objects.instance [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lazy-loading 'services' on Instance uuid 75e2202d-5c60-4b83-be99-f1a1e69f1ecd {{(pid=121067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:13:25.455051 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9a2e37fa-4a55-44c4-b9f7-3bdd0201ffb4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments/d95a95a0-0e87-4845-8030-93030ee8921a" status: 202 len: 0 microversion: 2.1 time: 0.329899 Sep 11 00:13:25.455563 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 545/1092] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Sep 11 00:13:25 2022] DELETE /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments/d95a95a0-0e87-4845-8030-93030ee8921a => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:13:25.465692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:25.468051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:25.475357 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:25.475833 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:25.476261 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:25.477072 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:25.477516 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:25.477930 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:25.507765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1c5a14d4-fc0d-491e-a658-4bdcb7c20405 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047207 Sep 11 00:13:25.508319 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 548/1093] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:13:25 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:13:26.521877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:26.524103 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:26.530268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:26.530794 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:26.531242 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:26.531897 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:26.532338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:26.532747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:26.562343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f528917b-835c-4a25-a40a-ede8aeaa9c78 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045834 Sep 11 00:13:26.562914 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 546/1094] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:13:26 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:13:27.575067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:27.577125 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:27.584001 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:27.584475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:27.584905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:27.585582 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:27.586027 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:27.586447 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:27.615721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-52876e2b-ae23-48e4-8e65-e9b3306074c6 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044711 Sep 11 00:13:27.616278 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 549/1095] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Sep 11 00:13:27 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:13:27.678260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:27.678766 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:27.685085 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:27.685562 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:27.685997 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:27.686768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:27.687225 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:27.687650 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:27.712907 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:13:28.051814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3a13a7ac-88ab-4b70-b736-0fb7eff6d177 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 204 len: 0 microversion: 2.1 time: 0.377707 Sep 11 00:13:28.052406 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 547/1096] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:13:27 2022] DELETE /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:13:28.060619 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:28.061232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:28.068134 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:28.068617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:28.069114 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:28.069793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:28.070250 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:28.070695 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:28.198533 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:13:28.206920 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-48a5ec42-6bb5-4ff4-920e-98b2cbdc4c6e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1683 microversion: 2.1 time: 0.150051 Sep 11 00:13:28.207491 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 550/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:28 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:13:29.231529 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:29.232235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:29.239502 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:29.239995 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:29.240431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:29.241118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:29.241569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:29.241992 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:29.381383 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:13:29.389298 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-344fe08f-8588-4e89-b95f-8763c4ce6d92 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1683 microversion: 2.1 time: 0.161815 Sep 11 00:13:29.389864 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 548/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:29 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:13:30.417658 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:30.418275 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:30.425777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:30.426263 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:30.426727 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:30.427431 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:30.427881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:30.428308 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:30.557330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:13:30.565075 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8c18c17e-55b7-499f-b7a0-04e3a5558c3c tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1683 microversion: 2.1 time: 0.151367 Sep 11 00:13:30.565651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 551/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:30 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:13:30.879426 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-edc64dda-5825-4457-a2a4-6c746ec912e5 req-e0197be1-d8db-4684-b9e1-0f2a4d0bff5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e2202d-5c60-4b83-be99-f1a1e69f1ecd", "name": "network-vif-deleted", "tag": "2ebb210c-ac78-4dde-9dd8-0db65e95ff10"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:13:30.894598 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-edc64dda-5825-4457-a2a4-6c746ec912e5 req-e0197be1-d8db-4684-b9e1-0f2a4d0bff5c service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:30.895105 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-edc64dda-5825-4457-a2a4-6c746ec912e5 req-e0197be1-d8db-4684-b9e1-0f2a4d0bff5c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:30.895536 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-edc64dda-5825-4457-a2a4-6c746ec912e5 req-e0197be1-d8db-4684-b9e1-0f2a4d0bff5c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:30.907054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-edc64dda-5825-4457-a2a4-6c746ec912e5 req-e0197be1-d8db-4684-b9e1-0f2a4d0bff5c service nova] Creating event network-vif-deleted:2ebb210c-ac78-4dde-9dd8-0db65e95ff10 for instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd on hv-cinder-85200 Sep 11 00:13:30.912667 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-edc64dda-5825-4457-a2a4-6c746ec912e5 req-e0197be1-d8db-4684-b9e1-0f2a4d0bff5c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036865 Sep 11 00:13:30.913711 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 549/1100] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:13:31.588258 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:31.588865 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:31.595279 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:31.595749 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:31.596175 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:31.596973 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:31.597415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:31.597831 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:31.629624 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:31.630104 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:31.630532 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:31.631002 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lazy-loading 'fault' on Instance uuid 75e2202d-5c60-4b83-be99-f1a1e69f1ecd {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:13:31.676291 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae921c806734b0a8218ea7453e8bd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261177a9929f4df4bff1d0c009b1b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:13:31.684208 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f61ed7fa-e1e3-4f57-b0a5-728a9feb9776 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 200 len: 1332 microversion: 2.1 time: 0.099741 Sep 11 00:13:31.684897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 552/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:31 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:13:32.709674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:32.710398 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:32.716716 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:32.717191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:32.717620 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:32.718303 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:32.718771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:32.719184 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:32.732961 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd HTTP/1.1 Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:13:32.734592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:32.738223 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '75e2202d-5c60-4b83-be99-f1a1e69f1ecd'} Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:32.739941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:32.742543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:32.744005 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:32.744005 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1bd4bf52-7c5d-445b-a374-7543108e500f tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 404 len: 111 microversion: 2.1 time: 0.031569 Sep 11 00:13:32.744005 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 550/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:32 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:13:32.746515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f26997a5-51ca-4e8a-b166-ba556d354ecd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '.version_select at 0x7f5ab67630d0>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:32.851295 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f26997a5-51ca-4e8a-b166-ba556d354ecd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253130247" status: 202 len: 0 microversion: 2.1 time: 0.109491 Sep 11 00:13:32.851922 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 553/1103] 10.222.0.17 () {58 vars in 1221 bytes} [Sun Sep 11 00:13:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253130247 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:13:34.937592 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:34.938090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:34.944493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:34.944970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:34.945403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:34.946087 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:34.946538 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:34.946995 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:34.961195 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd HTTP/1.1 Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:13:34.962765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:34.964228 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '75e2202d-5c60-4b83-be99-f1a1e69f1ecd'} Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:34.965057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:34.966396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:34.968569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:34.968569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a9d4b0c3-52b4-4229-994e-fca9b24964f4 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 404 len: 111 microversion: 2.1 time: 0.030422 Sep 11 00:13:34.968569 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 551/1104] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:13:34 2022] DELETE /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:13:34.973391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:34.974005 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 75e2202d-5c60-4b83-be99-f1a1e69f1ecd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:34.981068 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:34.986100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:34.986100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:34.986100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:34.986100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:34.986486 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:34.996327 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd HTTP/1.1 Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:13:34.997991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:34.999801 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '75e2202d-5c60-4b83-be99-f1a1e69f1ecd'} Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:35.000832 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. Sep 11 00:13:35.002324 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:35.004479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance 75e2202d-5c60-4b83-be99-f1a1e69f1ecd could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:35.004479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-aca13b1b-a875-4335-bc52-9e2d57261ca8 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd" status: 404 len: 111 microversion: 2.1 time: 0.030626 Sep 11 00:13:35.004479 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 554/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:34 2022] GET /compute/v2.1/servers/75e2202d-5c60-4b83-be99-f1a1e69f1ecd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 00:13:36.308482 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:36.308975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:36.315540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:36.316003 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:36.316429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:36.317103 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:36.317548 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:36.317961 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:36.331975 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 HTTP/1.1 Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:13:36.333497 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.335068 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'b6cdb29e-dcca-4d50-adf7-2be2674c36d8'} Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:36.335889 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.337156 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.338436 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:36.338436 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4b453318-40f7-402f-a9de-69c0efe9fa89 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 404 len: 111 microversion: 2.1 time: 0.030203 Sep 11 00:13:36.338436 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 552/1106] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:13:36 2022] DELETE /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:13:36.343314 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:36.343923 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: b6cdb29e-dcca-4d50-adf7-2be2674c36d8] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:36.350948 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:36.351424 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:36.351861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:36.352541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:36.352984 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:36.353401 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:36.369779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 HTTP/1.1 Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:13:36.371337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.372945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'b6cdb29e-dcca-4d50-adf7-2be2674c36d8'} Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:36.374048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. Sep 11 00:13:36.375595 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.377103 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance b6cdb29e-dcca-4d50-adf7-2be2674c36d8 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:36.377103 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-0375ea66-ea3c-4b1f-8911-6e6e4a09805a tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8" status: 404 len: 111 microversion: 2.1 time: 0.033189 Sep 11 00:13:36.377103 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 555/1107] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:36 2022] GET /compute/v2.1/servers/b6cdb29e-dcca-4d50-adf7-2be2674c36d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:13:36.381258 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:36.381756 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:36.387715 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:36.388197 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:36.388636 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:36.389319 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:36.389768 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:36.390191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:36.403923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 HTTP/1.1 Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:13:36.405437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.407061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': 'bdbc9c2d-254f-49b0-b81c-f25d3f988f11'} Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:36.407901 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.409985 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.411800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:36.411800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-36fb70a8-9628-4d7e-9086-bfb9b717a4fd tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 404 len: 111 microversion: 2.1 time: 0.029387 Sep 11 00:13:36.411800 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 553/1108] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:13:36 2022] DELETE /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 00:13:36.415695 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:36.416306 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: bdbc9c2d-254f-49b0-b81c-f25d3f988f11] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:36.422090 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:36.422569 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:36.423040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:36.423723 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:36.424170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:36.424636 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:36.437807 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 HTTP/1.1 Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:13:36.439339 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.441051 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'bdbc9c2d-254f-49b0-b81c-f25d3f988f11'} Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:36.441986 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. Sep 11 00:13:36.443271 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:36.444402 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance bdbc9c2d-254f-49b0-b81c-f25d3f988f11 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:36.444402 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3e17f7f4-5f7d-4aed-b59d-2ed0ad6e4cf1 tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11" status: 404 len: 111 microversion: 2.1 time: 0.028967 Sep 11 00:13:36.444402 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 556/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:36 2022] GET /compute/v2.1/servers/bdbc9c2d-254f-49b0-b81c-f25d3f988f11 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:13:37.766059 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:37.766562 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:37.773951 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:37.774435 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:37.774910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:37.775606 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:37.776061 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:37.776485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:37.792836 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: DELETE /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee HTTP/1.1 Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:13:37.794403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.796074 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '6945de1c-cdb3-4dd1-bc79-cd8d617396ee'} Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:37.796899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.798186 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.799544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:37.799544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4c50c488-b3e5-434d-b122-8cc48774852e tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 404 len: 111 microversion: 2.1 time: 0.033605 Sep 11 00:13:37.799544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 554/1110] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:13:37 2022] DELETE /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:13:37.804332 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:13:37.805013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] [instance: 6945de1c-cdb3-4dd1-bc79-cd8d617396ee] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:13:37.812284 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:37.812284 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:37.812498 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:37.813105 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:13:37.813557 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:13:37.813983 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:13:37.829843 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] HTTP exception thrown: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Request method failure captured: Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee HTTP/1.1 Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHScO8axYXTYr5op0u-3SRG5MTDo0nwvh3dUl-SXGOrBiR-PRH-4PdPxhN9ipcAgBaS8LVPTB7p4dwPLncu6WGmH6C4l5Rn5OXXdUOBeM0TPdPvsbdqeTdBYaZGzq4fEYrl7Io5q7toFDXHhk2h3oon8CqXSs6lpwkLiP7mihZjRU4uA Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:13:37.832536 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261177a9929f4df4bff1d0c009b1b3e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261177a9929f4df4bff1d0c009b1b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261177a9929f4df4bff1d0c009b1b3e2"}]}] Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 261177a9929f4df4bff1d0c009b1b3e2 Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-932541148 Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: 6ae921c806734b0a8218ea7453e8bd4e Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-AttachVolumeNegativeTest-932541148-project Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.834223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '6945de1c-cdb3-4dd1-bc79-cd8d617396ee'} Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:13:37.835171 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. Sep 11 00:13:37.836650 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:13:37.838017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] Returning 404 to user: Instance 6945de1c-cdb3-4dd1-bc79-cd8d617396ee could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:13:37.838017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-81a5f223-761d-4a8f-bba3-e5419134acdc tempest-AttachVolumeNegativeTest-932541148 tempest-AttachVolumeNegativeTest-932541148-project] 10.222.0.17 "GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee" status: 404 len: 111 microversion: 2.1 time: 0.033445 Sep 11 00:13:37.838017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 557/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:13:37 2022] GET /compute/v2.1/servers/6945de1c-cdb3-4dd1-bc79-cd8d617396ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:14:07.401916 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1030639991", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "networks": [{"uuid": "b37b5a6d-269e-4994-9e08-ae8bce5905ef"}]}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:07.411634 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:07.412288 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:07.463961 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] validate_networks() for [('b37b5a6d-269e-4994-9e08-ae8bce5905ef', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:14:07.818792 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:14:07.819205 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:14:07.819670 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:14:07.820101 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:14:07.820500 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:14:07.830285 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:07.830996 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:07.831426 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:07.832404 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:07.832874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:07.833291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:07.852474 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Getting quotas for project 797df5a0a5704d1683176044bf78b1a8. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:14:07.857090 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Getting quotas for user ade06693efb44ac38e0c7bca08f0dbae and project 797df5a0a5704d1683176044bf78b1a8. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:14:07.868607 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:14:07.870941 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:14:08.058625 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-8d40f9eb-284a-41db-ae43-aa1a4a089381 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660681 Sep 11 00:14:08.059400 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 555/1112] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:14:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:14:08.072276 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-bfe43e34-8101-4398-b2a3-9952fee75279 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:08.072887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-bfe43e34-8101-4398-b2a3-9952fee75279 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:08.075919 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:08.076902 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:08.130877 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-bfe43e34-8101-4398-b2a3-9952fee75279 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:08.138233 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-bfe43e34-8101-4398-b2a3-9952fee75279 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1214 microversion: 2.1 time: 0.069932 Sep 11 00:14:08.139029 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 558/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:08 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:14:09.163806 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:09.164396 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:09.171357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:09.172688 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:09.172688 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:09.172979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:09.173426 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:09.173840 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:09.235674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:09.243304 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-3f0d8e89-9df2-479f-8cac-f41291bd4563 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1218 microversion: 2.1 time: 0.084232 Sep 11 00:14:09.244010 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 556/1114] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:09 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:10.267757 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:10.268435 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:10.276811 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:10.277287 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:10.277722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:10.278405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:10.279757 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:10.280370 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:10.343793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:10.351303 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4dfbde39-e7de-4688-b808-7130dcd97bc9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1218 microversion: 2.1 time: 0.089104 Sep 11 00:14:10.351858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 559/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:10 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:11.373262 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:11.373890 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:11.392450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:11.392450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:11.392450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:11.392450 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:11.392885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:11.392885 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:11.448007 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:11.455866 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-4009be47-55a0-4146-a37e-c0f189557a41 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1218 microversion: 2.1 time: 0.086480 Sep 11 00:14:11.456632 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 557/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:11 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:12.479507 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:12.480120 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:12.488624 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:12.489109 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:12.492406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:12.492406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:12.492406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:12.492406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:12.553100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:12.562289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dccefd95-24bd-46b4-acc8-ee4010372319 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1266 microversion: 2.1 time: 0.086536 Sep 11 00:14:12.562910 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 560/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:12 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:13.585899 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:13.589260 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:13.593289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:13.593776 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:13.594215 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:13.595048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:13.595502 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:13.595924 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:13.661209 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:13.668939 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-94ca4d56-c643-4037-aac1-b8f4dd94e209 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1272 microversion: 2.1 time: 0.087285 Sep 11 00:14:13.669541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 558/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:13 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:14.692593 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:14.693207 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:14.699482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:14.699965 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:14.700403 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:14.701231 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:14.701683 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:14.702115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:14.767158 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-401d58ce-2416-431f-ab41-f7c9b62f8b49 req-26a9e42d-a345-4694-a041-d59e08fb07bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ac1094-ad78-4d3c-8fbc-4bafea3705bc", "tag": "c8680fda-0b6e-41af-9cfc-cc96c6cb63ba"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:14.784821 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-401d58ce-2416-431f-ab41-f7c9b62f8b49 req-26a9e42d-a345-4694-a041-d59e08fb07bd service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:14.785293 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-401d58ce-2416-431f-ab41-f7c9b62f8b49 req-26a9e42d-a345-4694-a041-d59e08fb07bd service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:14.785717 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-401d58ce-2416-431f-ab41-f7c9b62f8b49 req-26a9e42d-a345-4694-a041-d59e08fb07bd service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:14.803479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-401d58ce-2416-431f-ab41-f7c9b62f8b49 req-26a9e42d-a345-4694-a041-d59e08fb07bd service nova] Creating event network-changed:c8680fda-0b6e-41af-9cfc-cc96c6cb63ba for instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc on hv-cinder-85200 Sep 11 00:14:14.806402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-401d58ce-2416-431f-ab41-f7c9b62f8b49 req-26a9e42d-a345-4694-a041-d59e08fb07bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042487 Sep 11 00:14:14.807514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 559/1119] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:14:14.868578 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:14.877820 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-93a3893b-47b2-49a2-9a08-70375de965b3 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1314 microversion: 2.1 time: 0.189354 Sep 11 00:14:14.878396 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 561/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:14 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:15.901575 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:15.902269 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:15.909180 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:15.909660 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:15.910091 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:15.910874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:15.911321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:15.911739 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:16.010689 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-165320710", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-280477967", "security_groups": [{"name": "tempest-secgroup-smoke-106989926"}], "block_device_mapping_v2": [{"uuid": "e11d2928-4d57-4b3e-a173-3068b7be9a14", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcdda1c5-3ab3-4fad-9f02-121ff2f99084"}]}} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:16.049172 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:16.056827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f7876dab-091b-4682-a337-db4bfc5ed728 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1314 microversion: 2.1 time: 0.159886 Sep 11 00:14:16.057390 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 560/1121] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:15 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:16.126363 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.network.neutron [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] validate_networks() for [('fcdda1c5-3ab3-4fad-9f02-121ff2f99084', None, None, None, None, None)] {{(pid=121068) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:14:16.542038 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Flavor limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:14:16.542482 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Image limits 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:14:16.542995 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Flavor pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:14:16.543412 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Image pref 0:0:0 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:14:16.543816 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.virt.hardware [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:14:16.553004 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:16.553475 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:16.553901 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:16.554611 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:16.555095 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:16.555512 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:16.571659 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Getting quotas for project a819c981f44e4d21ab8b8289d16c19fb. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:14:16.575579 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.quota [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Getting quotas for user aa4f534ee1ab4e639e99b9e4ebbe8363 and project a819c981f44e4d21ab8b8289d16c19fb. Resources: {'instances', 'ram', 'cores'} {{(pid=121068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:14:16.632815 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Going to run 1 instances... {{(pid=121068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:14:16.634929 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e11d2928-4d57-4b3e-a173-3068b7be9a14',volume_size=None,volume_type=None)] {{(pid=121068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:14:17.042465 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c90113ae-1bff-49ab-b3e4-b8492493a00a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.035685 Sep 11 00:14:17.054857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bb8d7222-6a88-486f-bf54-a1d7d075429d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:17.055464 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bb8d7222-6a88-486f-bf54-a1d7d075429d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:17.055631 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 562/1122] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:14:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 00:14:17.087405 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:17.088048 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:17.095864 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:17.096358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:17.096793 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:17.097495 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:17.097945 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:17.098395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:17.116193 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bb8d7222-6a88-486f-bf54-a1d7d075429d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:17.123874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bb8d7222-6a88-486f-bf54-a1d7d075429d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1093 microversion: 2.1 time: 0.072828 Sep 11 00:14:17.124701 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 561/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:17 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:17.250359 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:17.258232 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b98f4c1b-8112-41a9-a04f-1086e6020d1b tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1314 microversion: 2.1 time: 0.174850 Sep 11 00:14:17.259165 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 563/1124] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:17 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:18.148001 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:18.148642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:18.150788 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:18.158368 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:18.158877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:18.159336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:18.160178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:18.160642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:18.161064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:18.228429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:18.236859 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-62b24348-7395-4332-b7bd-8b96a0f48b6c tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1143 microversion: 2.1 time: 0.093211 Sep 11 00:14:18.237413 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 562/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:18 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1143 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:14:18.281951 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:18.282570 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:18.288959 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:18.289430 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:18.289863 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:18.290541 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:18.291047 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:18.291468 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:18.420292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:18.428099 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d48877b5-0c6b-4f98-90bc-86f9e0624285 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1314 microversion: 2.1 time: 0.151119 Sep 11 00:14:18.428659 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 564/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:18 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:19.260250 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:19.260876 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:19.267948 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:19.268431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:19.268865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:19.269559 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:19.270063 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:19.270725 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:19.333444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:19.341432 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-eb6ac2f8-87ea-4a96-9579-6ebbd60d8c94 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1191 microversion: 2.1 time: 0.085191 Sep 11 00:14:19.342118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 563/1127] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:19 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:19.452764 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:19.453385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:19.460159 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:19.460638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:19.461082 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:19.461772 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:19.462224 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:19.462645 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:19.602198 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:19.610406 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f3d3c1ec-497d-4119-9044-b6f1b3e72f76 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1314 microversion: 2.1 time: 0.162467 Sep 11 00:14:19.611088 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 565/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:19 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:20.365393 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:20.365966 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:20.373540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:20.374468 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:20.374841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:20.375554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:20.376005 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:20.376473 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:20.609536 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:20.621595 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9dfa0ea6-bf3b-4149-b4f3-2c951e0d00fb tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1276 microversion: 2.1 time: 0.257768 Sep 11 00:14:20.621595 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 564/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:20 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:20.633584 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:20.634205 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:20.641032 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:20.641515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:20.642003 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:20.642705 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:20.643157 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:20.644631 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:20.785166 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:20.810515 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-f41f76ae-77ba-4400-be2d-57fd144d35c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1314 microversion: 2.1 time: 0.180540 Sep 11 00:14:20.811246 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 566/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:20 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:14:20.937367 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-e427c85a-885d-43cc-bd5e-1e89233f7d14 req-fbd23244-f3c1-468a-aeeb-b262cc0a2976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ac1094-ad78-4d3c-8fbc-4bafea3705bc", "name": "network-vif-plugged", "status": "completed", "tag": "c8680fda-0b6e-41af-9cfc-cc96c6cb63ba"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:20.947075 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-e427c85a-885d-43cc-bd5e-1e89233f7d14 req-fbd23244-f3c1-468a-aeeb-b262cc0a2976 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:20.947543 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-e427c85a-885d-43cc-bd5e-1e89233f7d14 req-fbd23244-f3c1-468a-aeeb-b262cc0a2976 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:20.947972 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-e427c85a-885d-43cc-bd5e-1e89233f7d14 req-fbd23244-f3c1-468a-aeeb-b262cc0a2976 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:20.959910 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-e427c85a-885d-43cc-bd5e-1e89233f7d14 req-fbd23244-f3c1-468a-aeeb-b262cc0a2976 service nova] Creating event network-vif-plugged:c8680fda-0b6e-41af-9cfc-cc96c6cb63ba for instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc on hv-cinder-85200 Sep 11 00:14:20.964903 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-e427c85a-885d-43cc-bd5e-1e89233f7d14 req-fbd23244-f3c1-468a-aeeb-b262cc0a2976 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032884 Sep 11 00:14:20.965492 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 565/1131] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:14:21.360906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-c135fca3-9411-4a9e-b698-edd3702ef9c4 req-839e8c81-8066-4de7-921b-38dd0fc01939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb0a09f-6327-412a-8d07-d18a585c49ac", "tag": "2c4b449f-6d2f-4190-b9fc-12afeb80338b"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:21.370598 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-c135fca3-9411-4a9e-b698-edd3702ef9c4 req-839e8c81-8066-4de7-921b-38dd0fc01939 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:21.371111 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-c135fca3-9411-4a9e-b698-edd3702ef9c4 req-839e8c81-8066-4de7-921b-38dd0fc01939 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:21.371563 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-c135fca3-9411-4a9e-b698-edd3702ef9c4 req-839e8c81-8066-4de7-921b-38dd0fc01939 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:21.383496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-c135fca3-9411-4a9e-b698-edd3702ef9c4 req-839e8c81-8066-4de7-921b-38dd0fc01939 service nova] Creating event network-changed:2c4b449f-6d2f-4190-b9fc-12afeb80338b for instance 1eb0a09f-6327-412a-8d07-d18a585c49ac on hv-cinder-85200 Sep 11 00:14:21.388466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-c135fca3-9411-4a9e-b698-edd3702ef9c4 req-839e8c81-8066-4de7-921b-38dd0fc01939 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032141 Sep 11 00:14:21.389067 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 567/1132] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:14:21.645064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:21.645748 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:21.651908 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:21.652386 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:21.652813 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:21.654030 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:21.654495 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:21.655019 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:21.786801 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:21.795240 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-750a7a2a-e496-4380-85ce-e80fe658b8a0 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.154004 Sep 11 00:14:21.795974 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 566/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:21 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:21.834759 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:21.835459 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:21.842410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:21.845745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:21.845745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:21.845745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:21.845745 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:21.846202 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:21.978453 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:21.986765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-00bb5f67-4867-445d-a7fb-3027290ed4a9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1314 microversion: 2.1 time: 0.157010 Sep 11 00:14:21.987323 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 568/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:21 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:22.824163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:22.824779 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:22.832289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:22.832778 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:22.833216 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:22.833918 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:22.834369 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:22.834857 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:22.969586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:22.977617 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5f0ade1d-e055-46d5-abb5-c20c46a9f02d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.157450 Sep 11 00:14:22.978216 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 567/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:22 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:23.009170 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:23.009787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:23.017116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:23.017599 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:23.018046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:23.018779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:23.019236 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:23.019657 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:23.150101 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:23.158795 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-713dc689-1a83-4f8d-a84c-39a733dffcb7 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1497 microversion: 2.1 time: 0.153441 Sep 11 00:14:23.159368 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 569/1136] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:23 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:24.000827 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:24.001458 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:24.007848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:24.008335 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:24.008746 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:24.009417 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:24.009856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:24.010268 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:24.144358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:24.144921 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:24.151811 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:24.151982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:24.152100 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:24.152453 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:24.153361 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:24.154358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:24.154808 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:24.159618 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-13e7c6a0-9b03-41dd-9bc1-6d35053ce21d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.162788 Sep 11 00:14:24.160191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 568/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:23 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:24.187070 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Going to try to terminate instance {{(pid=121068) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:14:24.433825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-087f406b-2d6e-4b5b-ac13-853f1d87535c tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 204 len: 0 microversion: 2.1 time: 0.292917 Sep 11 00:14:24.434404 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 570/1138] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:14:24 2022] DELETE /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:14:24.442790 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:24.443397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:24.449357 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:24.449828 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:24.450782 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:24.451546 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:24.451984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:24.452398 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:24.587231 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:24.595708 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a100c2ee-30a4-4363-baf1-23201bcfed52 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1503 microversion: 2.1 time: 0.156795 Sep 11 00:14:24.596282 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 569/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:24 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:25.187756 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:25.188415 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:25.194757 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:25.195239 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:25.195673 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:25.196355 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:25.196803 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:25.197225 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:25.334633 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:25.342900 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-52d7f0e9-0dcf-435e-956d-34d84706ce5e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.160032 Sep 11 00:14:25.343594 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 571/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:25 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:25.618734 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:25.619266 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:25.625845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:25.626343 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:25.626814 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:25.627493 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:25.627934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:25.628347 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:25.757565 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:25.766003 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-664ea4d2-587c-4080-8ef8-b4ea261d8ea4 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1503 microversion: 2.1 time: 0.151253 Sep 11 00:14:25.766564 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 570/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:25 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:26.365333 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:26.369953 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:26.372289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:26.372763 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:26.373722 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:26.374476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:26.375052 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:26.375478 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:26.511484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:26.519979 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a73f7ea5-a53a-4ab2-8568-bb61b09ca7ab tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.158473 Sep 11 00:14:26.520542 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 572/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:26 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:26.604605 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-8a3b54f2-9052-4fdf-bb10-64ff7495636c req-85e2bf57-c454-4d59-b634-1d33654da3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ac1094-ad78-4d3c-8fbc-4bafea3705bc", "name": "network-vif-deleted", "tag": "c8680fda-0b6e-41af-9cfc-cc96c6cb63ba"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:26.614680 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-8a3b54f2-9052-4fdf-bb10-64ff7495636c req-85e2bf57-c454-4d59-b634-1d33654da3d4 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:26.615175 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-8a3b54f2-9052-4fdf-bb10-64ff7495636c req-85e2bf57-c454-4d59-b634-1d33654da3d4 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:26.615605 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-8a3b54f2-9052-4fdf-bb10-64ff7495636c req-85e2bf57-c454-4d59-b634-1d33654da3d4 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:26.627452 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-8a3b54f2-9052-4fdf-bb10-64ff7495636c req-85e2bf57-c454-4d59-b634-1d33654da3d4 service nova] Creating event network-vif-deleted:c8680fda-0b6e-41af-9cfc-cc96c6cb63ba for instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc on hv-cinder-85200 Sep 11 00:14:26.632308 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-8a3b54f2-9052-4fdf-bb10-64ff7495636c req-85e2bf57-c454-4d59-b634-1d33654da3d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031585 Sep 11 00:14:26.632881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 571/1143] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:14:26.789518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:26.790041 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:26.791981 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:26.792640 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=8 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:26.798017 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:26.802366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:26.802366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:26.802366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:26.802366 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:26.802774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:26.863302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:26.871853 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1ff737e5-bafe-4427-b883-404cfc1fb5c9 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 200 len: 1299 microversion: 2.1 time: 0.086387 Sep 11 00:14:26.872414 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 573/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:26 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:27.544515 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=8 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:27.659955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:27.660654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:27.666877 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:27.668936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:27.668936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:27.668936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:27.668936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:27.669328 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:27.801934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:27.809815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-1453492c-3fbe-4147-af5d-b27dcadf7e3e tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.270136 Sep 11 00:14:27.810386 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 572/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:27 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:27.895675 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:27.896310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: c5ac1094-ad78-4d3c-8fbc-4bafea3705bc] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:27.989287 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:27.989774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:27.990295 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:27.991073 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:27.991522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:27.992040 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:28.006397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] HTTP exception thrown: Instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc could not be found. Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Request method failure captured: Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc HTTP/1.1 Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHShNBl-BOOtr7RJWP1xa3dQDmNMdJA8mx5SNm-05kwKrolm6JEZw4Ph541SjvQSLOjo899elj_faaGyU-EII2yrp-O9xJ0LrATPjT79gGsf7oxHY5H0sB2HBMbRrIetek6FtDmlS5eTq2UhPY4iZwaTodChJQG2hrWGtav5RQAlfkqA Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 797df5a0a5704d1683176044bf78b1a8 Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-VolumesActionsTest-402099083 Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:14:28.008065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_797df5a0a5704d1683176044bf78b1a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/797df5a0a5704d1683176044bf78b1a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/797df5a0a5704d1683176044bf78b1a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/797df5a0a5704d1683176044bf78b1a8"}]}] Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-VolumesActionsTest-402099083 Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 797df5a0a5704d1683176044bf78b1a8 Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-VolumesActionsTest-402099083 Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-VolumesActionsTest-402099083-project Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: ade06693efb44ac38e0c7bca08f0dbae Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-VolumesActionsTest-402099083-project Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc could not be found. Sep 11 00:14:28.009836 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'c5ac1094-ad78-4d3c-8fbc-4bafea3705bc'} Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc could not be found. Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:14:28.010861 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc could not be found. Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc could not be found. Sep 11 00:14:28.012340 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:28.013881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Returning 404 to user: Instance c5ac1094-ad78-4d3c-8fbc-4bafea3705bc could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:14:28.013881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-94578fbd-8f0f-4653-86c1-a3715d037e66 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc" status: 404 len: 111 microversion: 2.1 time: 0.118025 Sep 11 00:14:28.013881 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 574/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:27 2022] GET /compute/v2.1/servers/c5ac1094-ad78-4d3c-8fbc-4bafea3705bc => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:14:28.059674 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1722451727", "imageRef": "1000248f-052b-4a92-82cc-88ebbcf8b0dd", "flavorRef": "452", "networks": [{"uuid": "b37b5a6d-269e-4994-9e08-ae8bce5905ef"}]}} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:28.112764 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.network.neutron [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] validate_networks() for [('b37b5a6d-269e-4994-9e08-ae8bce5905ef', None, None, None, None, None)] {{(pid=121067) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:14:28.478561 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Flavor limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:14:28.479011 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Image limits 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:14:28.479477 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Flavor pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:14:28.479874 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Image pref 0:0:0 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:14:28.480277 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.virt.hardware [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:14:28.489604 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:28.490069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:28.490491 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:28.491243 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:28.491685 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:28.492097 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:28.508540 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Getting quotas for project 797df5a0a5704d1683176044bf78b1a8. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:14:28.512653 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.quota [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Getting quotas for user ade06693efb44ac38e0c7bca08f0dbae and project 797df5a0a5704d1683176044bf78b1a8. Resources: {'instances', 'ram', 'cores'} {{(pid=121067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:14:28.523688 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Going to run 1 instances... {{(pid=121067) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:14:28.525962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1000248f-052b-4a92-82cc-88ebbcf8b0dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:14:28.646654 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a40e1cfc-76f8-4b8c-ae21-e718ae9572e8 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590614 Sep 11 00:14:28.647403 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 573/1147] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Sep 11 00:14:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:14:28.658949 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-d180b515-f31b-4f39-8761-5599af5a0e5d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:28.659559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-d180b515-f31b-4f39-8761-5599af5a0e5d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:28.712729 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-d180b515-f31b-4f39-8761-5599af5a0e5d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:28.720787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-d180b515-f31b-4f39-8761-5599af5a0e5d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1214 microversion: 2.1 time: 0.066197 Sep 11 00:14:28.721353 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 575/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:28 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:28.838191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:28.838825 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:28.846510 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:28.847048 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:28.847471 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:28.848198 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:28.848642 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:28.849057 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:28.984711 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:28.992774 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6d9fd3a3-657c-4e15-a95e-de892d6af789 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.159133 Sep 11 00:14:29.002446 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 574/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:28 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:29.743663 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:29.744270 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:29.751670 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:29.752152 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:29.752588 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:29.753267 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:29.753717 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:29.754137 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:29.819531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:29.820217 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:29.824707 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-865d8a34-94ff-4ae6-b78c-48342d3f21d1 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1218 microversion: 2.1 time: 0.084982 Sep 11 00:14:29.825264 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 576/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:29 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:30.017137 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:30.017747 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:30.024146 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:30.024622 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:30.025054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:30.025729 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:30.026171 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:30.026582 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:30.156845 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:30.160279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=100 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:30.164836 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ddd0c89a-4116-428f-9990-56a89beb78bc tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.152205 Sep 11 00:14:30.165409 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 575/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:30 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:30.848173 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:30.848753 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:30.855817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:30.856289 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:30.856721 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:30.858208 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:30.858476 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:30.858887 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:30.924634 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:30.932213 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-7ebdee0b-1a8c-4568-93de-07e98e7679fd tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1266 microversion: 2.1 time: 0.087985 Sep 11 00:14:30.932699 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 577/1152] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:30 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:31.188705 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:31.189321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:31.195928 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:31.196412 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:31.196839 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:31.197521 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:31.197968 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:31.198384 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:31.416069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:31.424279 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-ee50010f-521d-4e64-a4ba-237e710d6da9 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.240420 Sep 11 00:14:31.424948 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 576/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:31 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:14:31.955779 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:31.956429 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:31.963093 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:31.963575 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:31.964013 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:31.964700 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:31.965154 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:31.965581 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:32.028728 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:32.036896 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-51a0013e-14ea-4e24-b3f9-6ffa4e172768 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1272 microversion: 2.1 time: 0.085682 Sep 11 00:14:32.038938 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 578/1154] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:31 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:32.448802 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:32.449551 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:32.456271 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:32.459744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:32.459744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:32.459744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:32.459744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:32.460163 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:32.656892 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:32.664775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-2f90d553-bb72-4ba0-bf42-7e11fae700f7 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.220404 Sep 11 00:14:32.665349 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 577/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:32 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:33.060651 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:33.061364 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:33.067713 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:33.068194 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:33.068632 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:33.069322 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:33.069771 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:33.070192 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:33.191299 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-484bf173-8458-49cf-9f69-23813ac11db9 req-2cd4e40e-c7c7-4968-97cc-0f0af2aea62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df54d6b0-20ce-4dac-954d-7b02ba74a9cd", "tag": "0e65a756-ac3f-4a2d-9e8b-090bb536d58f"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:33.205162 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-484bf173-8458-49cf-9f69-23813ac11db9 req-2cd4e40e-c7c7-4968-97cc-0f0af2aea62c service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:33.205923 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-484bf173-8458-49cf-9f69-23813ac11db9 req-2cd4e40e-c7c7-4968-97cc-0f0af2aea62c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:33.206721 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-484bf173-8458-49cf-9f69-23813ac11db9 req-2cd4e40e-c7c7-4968-97cc-0f0af2aea62c service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:33.210606 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:33.219778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-59c4950f-cd76-4600-b158-dd42b00f0072 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1314 microversion: 2.1 time: 0.162712 Sep 11 00:14:33.224860 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 579/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:33 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:33.227429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-484bf173-8458-49cf-9f69-23813ac11db9 req-2cd4e40e-c7c7-4968-97cc-0f0af2aea62c service nova] Creating event network-changed:0e65a756-ac3f-4a2d-9e8b-090bb536d58f for instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd on hv-cinder-85200 Sep 11 00:14:33.237203 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-484bf173-8458-49cf-9f69-23813ac11db9 req-2cd4e40e-c7c7-4968-97cc-0f0af2aea62c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052407 Sep 11 00:14:33.237748 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 578/1157] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:14:33.688451 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:33.689204 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:33.695093 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:33.698292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:33.698292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:33.698292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:33.698292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:33.698787 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:33.843853 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:33.851821 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3fd5cb26-c422-45f7-8e0f-8d3575526d63 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.168063 Sep 11 00:14:33.852390 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 580/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:33 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:34.245304 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:34.246318 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:34.253812 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:34.254294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:34.254762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:34.255467 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:34.255913 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:34.256332 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:34.414802 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:34.423287 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-f265fe58-24f7-48f0-9df6-96a36d6ae920 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1314 microversion: 2.1 time: 0.183411 Sep 11 00:14:34.423856 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 579/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:34 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:34.875924 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:34.876529 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:34.883259 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:34.884325 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:34.884752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:34.885750 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:34.886201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:34.886617 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:34.991517 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-4cd63421-5ac2-4b5d-8fe1-655502c2644b req-1a99be39-7692-472f-ac87-4e639e84d068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb0a09f-6327-412a-8d07-d18a585c49ac", "name": "network-vif-plugged", "status": "completed", "tag": "2c4b449f-6d2f-4190-b9fc-12afeb80338b"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:35.004806 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-4cd63421-5ac2-4b5d-8fe1-655502c2644b req-1a99be39-7692-472f-ac87-4e639e84d068 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:35.005295 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-4cd63421-5ac2-4b5d-8fe1-655502c2644b req-1a99be39-7692-472f-ac87-4e639e84d068 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:35.005732 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-4cd63421-5ac2-4b5d-8fe1-655502c2644b req-1a99be39-7692-472f-ac87-4e639e84d068 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:35.021848 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-4cd63421-5ac2-4b5d-8fe1-655502c2644b req-1a99be39-7692-472f-ac87-4e639e84d068 service nova] Creating event network-vif-plugged:2c4b449f-6d2f-4190-b9fc-12afeb80338b for instance 1eb0a09f-6327-412a-8d07-d18a585c49ac on hv-cinder-85200 Sep 11 00:14:35.026927 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-4cd63421-5ac2-4b5d-8fe1-655502c2644b req-1a99be39-7692-472f-ac87-4e639e84d068 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039017 Sep 11 00:14:35.031373 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 580/1160] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:14:35.055064 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:35.062869 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-63f1c483-8f5f-4830-adc5-498702b15039 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.191298 Sep 11 00:14:35.063759 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 581/1161] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:34 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:35.448796 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:35.449488 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:35.456321 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:35.456841 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:35.457521 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:35.458215 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:35.458678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:35.459100 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:35.626069 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:35.633775 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-11a1be97-387e-4474-8ebd-f3075437ee14 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1314 microversion: 2.1 time: 0.189630 Sep 11 00:14:35.634338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 581/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:35 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:36.085956 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:36.086755 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:36.093430 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:36.093905 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:36.094337 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:36.095046 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:36.095494 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:36.095915 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:36.228673 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:36.236539 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b1cdd013-7db5-4741-aa5a-0a9ec16ee103 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.154911 Sep 11 00:14:36.237098 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 582/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:36 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:36.657491 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:36.658044 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:36.664758 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:36.665291 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:36.665744 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:36.666431 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:36.667006 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:36.667437 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:36.801050 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:36.808939 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-383a5fb7-2543-4ddd-b1df-bf7f975dbe61 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1314 microversion: 2.1 time: 0.155974 Sep 11 00:14:36.809690 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 582/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:36 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:37.258978 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:37.259531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:37.266003 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:37.272817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:37.272817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:37.272817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:37.272817 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:37.273241 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:37.406522 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:37.414518 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-b415e5f0-3e77-404c-8f38-4ec84dd059ee tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1264 microversion: 2.1 time: 0.159438 Sep 11 00:14:37.418710 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 583/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:37 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:37.832859 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:37.833463 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:37.835894 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:37.840699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:37.841173 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:37.841599 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:37.842314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:37.842815 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:37.843230 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:37.972914 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:37.980443 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5c8e7217-6b1e-42f5-bc3f-9dae7a1d1727 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1314 microversion: 2.1 time: 0.151753 Sep 11 00:14:37.980999 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 583/1166] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:37 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:14:38.437960 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:38.438559 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:38.444907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:38.445397 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:38.445826 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:38.446498 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:38.446967 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:38.447385 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:38.579029 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:38.587656 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-15b291d4-4b3d-4363-9cc8-a207c769eddd tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1451 microversion: 2.1 time: 0.154167 Sep 11 00:14:38.588935 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 584/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:38 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:14:38.610583 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:38.611216 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:38.613103 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=2 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:38.613762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell0:SELECT=6 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:38.618611 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:38.619169 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:38.619554 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:38.620244 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:38.620696 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:38.621117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:38.758830 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:38.767191 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-cf5124b4-513c-49e9-8dbc-61866b18b7f1 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1451 microversion: 2.1 time: 0.161216 Sep 11 00:14:38.767769 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 584/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:38 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:38.975110 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-ae087ef1-119d-4b3d-8149-502e3f35380e req-e6fdd1d8-8137-44f4-bffb-b0b72967149d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df54d6b0-20ce-4dac-954d-7b02ba74a9cd", "name": "network-vif-plugged", "status": "completed", "tag": "0e65a756-ac3f-4a2d-9e8b-090bb536d58f"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:38.980310 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell0:SELECT=2 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:38.986813 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ae087ef1-119d-4b3d-8149-502e3f35380e req-e6fdd1d8-8137-44f4-bffb-b0b72967149d service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:38.989982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ae087ef1-119d-4b3d-8149-502e3f35380e req-e6fdd1d8-8137-44f4-bffb-b0b72967149d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:38.989982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-ae087ef1-119d-4b3d-8149-502e3f35380e req-e6fdd1d8-8137-44f4-bffb-b0b72967149d service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:39.002886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-ae087ef1-119d-4b3d-8149-502e3f35380e req-e6fdd1d8-8137-44f4-bffb-b0b72967149d service nova] Creating event network-vif-plugged:0e65a756-ac3f-4a2d-9e8b-090bb536d58f for instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd on hv-cinder-85200 Sep 11 00:14:39.004157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:39.005544 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:39.008774 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-ae087ef1-119d-4b3d-8149-502e3f35380e req-e6fdd1d8-8137-44f4-bffb-b0b72967149d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037088 Sep 11 00:14:39.009694 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 585/1169] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:14:39.012909 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:39.013388 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:39.013812 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:39.014713 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:39.015344 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:39.015758 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:39.240336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:39.250865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-384f2dd1-742c-417f-b76f-ae2ceefde987 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1314 microversion: 2.1 time: 0.248029 Sep 11 00:14:39.250865 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 585/1170] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:38 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:14:40.273866 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:40.274566 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:40.281769 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:40.287493 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:40.287493 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:40.287493 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:40.287493 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:40.287854 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:40.439813 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:40.447531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-fe527fe8-48ab-4450-8dc4-cdb14f76efb2 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1314 microversion: 2.1 time: 0.179116 Sep 11 00:14:40.448085 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 586/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:40 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:41.137762 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-75a5a575-f9e0-4b0a-8fe3-c46cc9a95545 req-462ef347-6c04-44b2-b649-784acc509331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb0a09f-6327-412a-8d07-d18a585c49ac", "tag": "2c4b449f-6d2f-4190-b9fc-12afeb80338b"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:41.148582 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-75a5a575-f9e0-4b0a-8fe3-c46cc9a95545 req-462ef347-6c04-44b2-b649-784acc509331 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:41.149059 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-75a5a575-f9e0-4b0a-8fe3-c46cc9a95545 req-462ef347-6c04-44b2-b649-784acc509331 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:41.149480 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-75a5a575-f9e0-4b0a-8fe3-c46cc9a95545 req-462ef347-6c04-44b2-b649-784acc509331 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:41.161213 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-75a5a575-f9e0-4b0a-8fe3-c46cc9a95545 req-462ef347-6c04-44b2-b649-784acc509331 service nova] Creating event network-changed:2c4b449f-6d2f-4190-b9fc-12afeb80338b for instance 1eb0a09f-6327-412a-8d07-d18a585c49ac on hv-cinder-85200 Sep 11 00:14:41.166083 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-75a5a575-f9e0-4b0a-8fe3-c46cc9a95545 req-462ef347-6c04-44b2-b649-784acc509331 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032233 Sep 11 00:14:41.166946 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 586/1172] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:14:41.470554 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:41.471201 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:41.474086 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:14:41.479047 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:41.479535 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:41.479968 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:41.480847 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:41.481330 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:41.481784 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:41.624288 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:41.633488 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-3e5bf84b-4ce0-491d-81b7-a486ddeb6f51 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1497 microversion: 2.1 time: 0.167452 Sep 11 00:14:41.637160 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 587/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:41 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:42.587546 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:42.588131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:42.594934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:42.595402 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:42.595837 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:42.596562 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:42.597008 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:42.597429 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:42.622860 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:14:42.890444 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-048549b4-c95f-4fd9-a26c-7e84b863b35d tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "DELETE /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 204 len: 0 microversion: 2.1 time: 0.306743 Sep 11 00:14:42.890982 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 587/1174] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:14:42 2022] DELETE /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:14:42.899314 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:42.899926 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:42.906754 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:42.907241 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:42.907678 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:42.908371 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:42.908825 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:42.909254 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:43.043181 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:43.051484 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-23c0c85b-f540-4b95-b0a6-8fc96ef2c574 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1503 microversion: 2.1 time: 0.155993 Sep 11 00:14:43.052058 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 588/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:42 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:44.074469 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:44.075190 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:44.082479 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:44.082987 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:44.083414 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:44.084085 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:44.084530 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:44.084942 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:44.217541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:44.225141 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-bb86aa2a-dbac-4bf3-9676-7d75a200aa5f tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1503 microversion: 2.1 time: 0.154955 Sep 11 00:14:44.225699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 588/1176] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:44 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:45.018622 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-833d6f97-2fd6-4846-8457-c0b3924367e2 req-6a7acf79-9775-4e13-8485-1df5feb05dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df54d6b0-20ce-4dac-954d-7b02ba74a9cd", "name": "network-vif-deleted", "tag": "0e65a756-ac3f-4a2d-9e8b-090bb536d58f"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:14:45.028607 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-833d6f97-2fd6-4846-8457-c0b3924367e2 req-6a7acf79-9775-4e13-8485-1df5feb05dde service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:45.029073 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-833d6f97-2fd6-4846-8457-c0b3924367e2 req-6a7acf79-9775-4e13-8485-1df5feb05dde service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:45.029496 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-833d6f97-2fd6-4846-8457-c0b3924367e2 req-6a7acf79-9775-4e13-8485-1df5feb05dde service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:45.041312 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-833d6f97-2fd6-4846-8457-c0b3924367e2 req-6a7acf79-9775-4e13-8485-1df5feb05dde service nova] Creating event network-vif-deleted:0e65a756-ac3f-4a2d-9e8b-090bb536d58f for instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd on hv-cinder-85200 Sep 11 00:14:45.046784 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-833d6f97-2fd6-4846-8457-c0b3924367e2 req-6a7acf79-9775-4e13-8485-1df5feb05dde service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032322 Sep 11 00:14:45.047381 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 589/1177] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:14:45.248900 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:45.249652 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:45.256492 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:45.256966 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:45.257397 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:45.258071 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:45.258514 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:45.259016 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:45.325703 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade06693efb44ac38e0c7bca08f0dbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '797df5a0a5704d1683176044bf78b1a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:14:45.334294 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-69b7fc6f-fd1c-4e14-87a0-fd82f1e56d20 tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 200 len: 1299 microversion: 2.1 time: 0.089456 Sep 11 00:14:45.334886 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 589/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:45 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:14:46.359290 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:14:46.359991 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] [instance: df54d6b0-20ce-4dac-954d-7b02ba74a9cd] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:14:46.370907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:46.370907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:46.370907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:46.370907 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:14:46.371344 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:14:46.371344 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:14:46.382253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] HTTP exception thrown: Instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd could not be found. Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Request method failure captured: Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd HTTP/1.1 Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHShNBl-BOOtr7RJWP1xa3dQDmNMdJA8mx5SNm-05kwKrolm6JEZw4Ph541SjvQSLOjo899elj_faaGyU-EII2yrp-O9xJ0LrATPjT79gGsf7oxHY5H0sB2HBMbRrIetek6FtDmlS5eTq2UhPY4iZwaTodChJQG2hrWGtav5RQAlfkqA Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: 797df5a0a5704d1683176044bf78b1a8 Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-VolumesActionsTest-402099083 Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:14:46.383906 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_797df5a0a5704d1683176044bf78b1a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/797df5a0a5704d1683176044bf78b1a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/797df5a0a5704d1683176044bf78b1a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/797df5a0a5704d1683176044bf78b1a8"}]}] Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-VolumesActionsTest-402099083 Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: 797df5a0a5704d1683176044bf78b1a8 Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-VolumesActionsTest-402099083 Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-VolumesActionsTest-402099083-project Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: ade06693efb44ac38e0c7bca08f0dbae Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-VolumesActionsTest-402099083-project Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd could not be found. Sep 11 00:14:46.385625 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': 'df54d6b0-20ce-4dac-954d-7b02ba74a9cd'} Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd could not be found. Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:14:46.386591 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd could not be found. Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd could not be found. Sep 11 00:14:46.388292 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:14:46.390526 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] Returning 404 to user: Instance df54d6b0-20ce-4dac-954d-7b02ba74a9cd could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:14:46.390526 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-26bb12e6-3af8-41b9-80c5-8ab0a82e428a tempest-VolumesActionsTest-402099083 tempest-VolumesActionsTest-402099083-project] 10.222.0.17 "GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd" status: 404 len: 111 microversion: 2.1 time: 0.031698 Sep 11 00:14:46.390526 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 590/1179] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:14:46 2022] GET /compute/v2.1/servers/df54d6b0-20ce-4dac-954d-7b02ba74a9cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:16:20.966196 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_api:SELECT=7 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:16:20.968116 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG dbcounter [-] [121068] Writing DB stats nova_cell1:SELECT=72 {{(pid=121068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:16:20.968424 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:20.969600 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 00:16:20.969810 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:20.969982 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Sun Sep 11 00:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 11 00:16:20.974923 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-6052b62f-192c-4438-befd-d7a9414b9004 req-f9c17f59-3432-46a6-a4e4-1a7a34fa8146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb0a09f-6327-412a-8d07-d18a585c49ac", "tag": "2c4b449f-6d2f-4190-b9fc-12afeb80338b"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:16:20.977934 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 11 00:16:20.978121 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Sun Sep 11 00:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac (ip 10.222.0.17) !!! Sep 11 00:16:20.979070 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:16:20.979970 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG dbcounter [-] [121067] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:16:20.982056 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:20.983082 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:20.983783 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:20.984936 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:20.986115 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-6052b62f-192c-4438-befd-d7a9414b9004 req-f9c17f59-3432-46a6-a4e4-1a7a34fa8146 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:20.987044 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-6052b62f-192c-4438-befd-d7a9414b9004 req-f9c17f59-3432-46a6-a4e4-1a7a34fa8146 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:20.987472 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-6052b62f-192c-4438-befd-d7a9414b9004 req-f9c17f59-3432-46a6-a4e4-1a7a34fa8146 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:20.998508 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:20.999356 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:20.999897 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-6052b62f-192c-4438-befd-d7a9414b9004 req-f9c17f59-3432-46a6-a4e4-1a7a34fa8146 service nova] Creating event network-changed:2c4b449f-6d2f-4190-b9fc-12afeb80338b for instance 1eb0a09f-6327-412a-8d07-d18a585c49ac on hv-cinder-85200 Sep 11 00:16:21.005395 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-6052b62f-192c-4438-befd-d7a9414b9004 req-f9c17f59-3432-46a6-a4e4-1a7a34fa8146 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041029 Sep 11 00:16:21.006770 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 591/1180] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:16:21.033117 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:16:21.312307 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9d8c0a1b-c36d-47f2-ab7d-57a231860e99 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 204 len: 0 microversion: 2.1 time: 0.350344 Sep 11 00:16:21.313131 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 590/1181] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:16:20 2022] DELETE /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:16:21.323260 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:21.324223 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:21.336242 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:21.336777 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:21.337391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:21.341299 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:21.341765 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:21.343001 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:21.632009 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:16:21.639858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-4e8cc0ce-1a4d-4184-8b68-10281dc15815 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1575 microversion: 2.1 time: 0.322230 Sep 11 00:16:21.640422 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 592/1182] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:21 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1575 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:16:22.664433 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:22.665130 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:22.672862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:22.673338 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:22.673771 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:22.674454 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:22.674926 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:22.675346 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:23.224152 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:16:23.232640 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-b8f6a7c1-517d-40a6-a624-c0245ee6da4b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1575 microversion: 2.1 time: 0.571786 Sep 11 00:16:23.240881 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 591/1183] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:22 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1575 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:16:24.133375 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-21d8b189-41a6-4bb7-97d8-df2253c3e0e1 req-2f8a65d5-b01e-47c7-b6d9-ef7120bf966b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb0a09f-6327-412a-8d07-d18a585c49ac", "name": "network-vif-deleted", "tag": "2c4b449f-6d2f-4190-b9fc-12afeb80338b"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:16:24.145059 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-21d8b189-41a6-4bb7-97d8-df2253c3e0e1 req-2f8a65d5-b01e-47c7-b6d9-ef7120bf966b service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:24.145623 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-21d8b189-41a6-4bb7-97d8-df2253c3e0e1 req-2f8a65d5-b01e-47c7-b6d9-ef7120bf966b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:24.146054 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-21d8b189-41a6-4bb7-97d8-df2253c3e0e1 req-2f8a65d5-b01e-47c7-b6d9-ef7120bf966b service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:24.157560 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-21d8b189-41a6-4bb7-97d8-df2253c3e0e1 req-2f8a65d5-b01e-47c7-b6d9-ef7120bf966b service nova] Creating event network-vif-deleted:2c4b449f-6d2f-4190-b9fc-12afeb80338b for instance 1eb0a09f-6327-412a-8d07-d18a585c49ac on hv-cinder-85200 Sep 11 00:16:24.162748 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-21d8b189-41a6-4bb7-97d8-df2253c3e0e1 req-2f8a65d5-b01e-47c7-b6d9-ef7120bf966b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Sep 11 00:16:24.163342 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 593/1184] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:16:24.260699 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:24.261314 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:24.267933 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:24.268706 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:24.268853 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:24.269542 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:24.269992 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:24.270420 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:24.335701 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:16:24.344325 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-5dc3eb5f-1e82-46a0-8f9a-b5760bad363b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1390 microversion: 2.1 time: 0.087458 Sep 11 00:16:24.344840 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 592/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:24 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:16:25.368550 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:25.369240 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:25.376524 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:25.377034 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:25.377531 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:25.378207 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:25.378648 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:25.379086 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:25.411977 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:25.412444 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:25.412872 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:25.413305 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lazy-loading 'fault' on Instance uuid 1eb0a09f-6327-412a-8d07-d18a585c49ac {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:16:25.460692 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:16:25.468534 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-8e5e5b64-f9fb-463b-9f63-a48f5cf3591f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 200 len: 1229 microversion: 2.1 time: 0.104256 Sep 11 00:16:25.469142 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 594/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:25 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:16:26.491962 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:26.492553 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 1eb0a09f-6327-412a-8d07-d18a585c49ac] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:26.499640 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:26.500111 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:26.500541 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:26.501216 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:26.501656 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:26.502070 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:26.514969 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] HTTP exception thrown: Instance 1eb0a09f-6327-412a-8d07-d18a585c49ac could not be found. Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Request method failure captured: Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac HTTP/1.1 Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScv7ZFT1SnGrjDI2PY0xZVpQwJgL6f66NFIVzkEsgalpf6mTh8hxGyn6Sd85a80ITe6EUsEL81gpl6OCzp757262hpPawwWZcZg_vhmTdCKr8eUpWlwB_ElJqigSoh8ZMXz5Fiubb_XyD5Z1lQYzfE-x6sUi6p3PzFWBK0w1tutaAM Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:16:26.516577 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a819c981f44e4d21ab8b8289d16c19fb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}] Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: aa4f534ee1ab4e639e99b9e4ebbe8363 Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 1eb0a09f-6327-412a-8d07-d18a585c49ac could not be found. Sep 11 00:16:26.518364 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '1eb0a09f-6327-412a-8d07-d18a585c49ac'} Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb0a09f-6327-412a-8d07-d18a585c49ac could not be found. Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:16:26.519351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb0a09f-6327-412a-8d07-d18a585c49ac could not be found. Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb0a09f-6327-412a-8d07-d18a585c49ac could not be found. Sep 11 00:16:26.520818 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:26.522102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Returning 404 to user: Instance 1eb0a09f-6327-412a-8d07-d18a585c49ac could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:16:26.522102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-89ddf784-8a4f-4d37-80ce-d82c9b6af70a tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac" status: 404 len: 111 microversion: 2.1 time: 0.029834 Sep 11 00:16:26.522102 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 593/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:26 2022] GET /compute/v2.1/servers/1eb0a09f-6327-412a-8d07-d18a585c49ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:16:29.891804 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [req-d3609536-2ca9-4d34-8a13-ea55e7971e9f req-66304524-69bc-4ab7-89f1-ef6062bfeed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fb3b0e-0f52-4322-8416-2c1407d1a73d", "tag": "6b78e9e6-43d4-4917-b6ae-8796aad5b368"}]} {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:16:29.896289 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:29.896920 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:29.901391 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-d3609536-2ca9-4d34-8a13-ea55e7971e9f req-66304524-69bc-4ab7-89f1-ef6062bfeed5 service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:29.901858 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-d3609536-2ca9-4d34-8a13-ea55e7971e9f req-66304524-69bc-4ab7-89f1-ef6062bfeed5 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:29.902278 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [req-d3609536-2ca9-4d34-8a13-ea55e7971e9f req-66304524-69bc-4ab7-89f1-ef6062bfeed5 service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:29.903572 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:29.904054 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:29.904485 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:29.905178 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:29.905623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:29.906039 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:29.913688 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.compute.server_external_events [req-d3609536-2ca9-4d34-8a13-ea55e7971e9f req-66304524-69bc-4ab7-89f1-ef6062bfeed5 service nova] Creating event network-changed:6b78e9e6-43d4-4917-b6ae-8796aad5b368 for instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d on hv-cinder-85200 Sep 11 00:16:29.919778 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [req-d3609536-2ca9-4d34-8a13-ea55e7971e9f req-66304524-69bc-4ab7-89f1-ef6062bfeed5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031342 Sep 11 00:16:29.920716 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 595/1188] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:16:29.932147 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Going to try to terminate instance {{(pid=121067) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:16:30.243729 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-d4be9303-b09c-4bad-944e-303eebcfd47b tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 204 len: 0 microversion: 2.1 time: 0.351919 Sep 11 00:16:30.244765 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 594/1189] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:16:29 2022] DELETE /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:16:30.254623 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:30.255648 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:30.261752 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:30.262302 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:30.263127 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:30.263899 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:30.264441 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:30.264925 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:30.406886 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:16:30.414811 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1b6d474c-7539-47bb-a1ac-d62227de04d2 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1577 microversion: 2.1 time: 0.164480 Sep 11 00:16:30.415380 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 596/1190] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:30 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:16:31.439979 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:31.440678 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:31.447107 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:31.447586 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:31.448015 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:31.448697 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:31.449157 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:31.449582 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:31.587118 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.policy [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121067) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:16:31.595794 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-9dcc2664-f8a1-4e31-9954-8516feaddd1f tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1577 microversion: 2.1 time: 0.160716 Sep 11 00:16:31.596351 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 595/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:31 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:16:32.619501 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:32.620065 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:32.627463 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:32.627946 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:32.628499 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:32.629189 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:32.629638 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:32.630058 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:32.779862 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:16:32.788328 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-1d7c9a79-44ce-471f-935e-7b909e704152 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1459 microversion: 2.1 time: 0.173072 Sep 11 00:16:32.789206 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 597/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:32 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1459 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:16:32.805188 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [req-832b0564-3c53-4317-92fc-bd74b806b2ae req-b753fea6-fd12-47d3-bbda-d3b5039110cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb3b0e-0f52-4322-8416-2c1407d1a73d", "name": "network-vif-deleted", "tag": "6b78e9e6-43d4-4917-b6ae-8796aad5b368"}]} {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:16:32.816693 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-832b0564-3c53-4317-92fc-bd74b806b2ae req-b753fea6-fd12-47d3-bbda-d3b5039110cd service nova] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:32.817160 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-832b0564-3c53-4317-92fc-bd74b806b2ae req-b753fea6-fd12-47d3-bbda-d3b5039110cd service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:32.817670 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [req-832b0564-3c53-4317-92fc-bd74b806b2ae req-b753fea6-fd12-47d3-bbda-d3b5039110cd service nova] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:32.831362 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.compute.server_external_events [req-832b0564-3c53-4317-92fc-bd74b806b2ae req-b753fea6-fd12-47d3-bbda-d3b5039110cd service nova] Creating event network-vif-deleted:6b78e9e6-43d4-4917-b6ae-8796aad5b368 for instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d on hv-cinder-85200 Sep 11 00:16:32.836990 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [req-832b0564-3c53-4317-92fc-bd74b806b2ae req-b753fea6-fd12-47d3-bbda-d3b5039110cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035622 Sep 11 00:16:32.837568 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 596/1193] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Sep 11 00:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:16:33.812487 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:33.813161 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:33.820132 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:33.820624 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:33.821057 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:33.821741 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:33.822187 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:33.822627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:33.855411 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:33.855884 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:33.856316 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:33.856761 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.objects.instance [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lazy-loading 'fault' on Instance uuid 99fb3b0e-0f52-4322-8416-2c1407d1a73d {{(pid=121068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:16:33.897620 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.policy [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4f534ee1ab4e639e99b9e4ebbe8363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a819c981f44e4d21ab8b8289d16c19fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121068) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:16:33.905410 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-dfb6a63f-dc71-4b7f-a6aa-816c23cc8908 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 200 len: 1230 microversion: 2.1 time: 0.097011 Sep 11 00:16:33.905971 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 598/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:33 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:16:34.930337 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:34.931049 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 99fb3b0e-0f52-4322-8416-2c1407d1a73d] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:34.937955 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:34.939099 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:34.939561 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:34.940235 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:34.940677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:34.941106 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:34.954980 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] HTTP exception thrown: Instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d could not be found. Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Request method failure captured: Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d HTTP/1.1 Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScv7ZFT1SnGrjDI2PY0xZVpQwJgL6f66NFIVzkEsgalpf6mTh8hxGyn6Sd85a80ITe6EUsEL81gpl6OCzp757262hpPawwWZcZg_vhmTdCKr8eUpWlwB_ElJqigSoh8ZMXz5Fiubb_XyD5Z1lQYzfE-x6sUi6p3PzFWBK0w1tutaAM Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:16:34.956639 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a819c981f44e4d21ab8b8289d16c19fb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}] Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: aa4f534ee1ab4e639e99b9e4ebbe8363 Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d could not be found. Sep 11 00:16:34.958342 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '99fb3b0e-0f52-4322-8416-2c1407d1a73d'} Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d could not be found. Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:16:34.959623 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d could not be found. Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d could not be found. Sep 11 00:16:34.961320 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:34.962945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Returning 404 to user: Instance 99fb3b0e-0f52-4322-8416-2c1407d1a73d could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:16:34.962945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-a9ea9d2e-f4d1-4174-968b-c77345cb2b47 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d" status: 404 len: 111 microversion: 2.1 time: 0.031908 Sep 11 00:16:34.962945 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 597/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:34 2022] GET /compute/v2.1/servers/99fb3b0e-0f52-4322-8416-2c1407d1a73d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:16:35.463186 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:35.463699 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.compute.api [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121068) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:35.470883 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:35.471358 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:35.471788 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:35.472466 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:35.472910 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:35.473329 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG oslo_concurrency.lockutils [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:35.487614 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.wsgi [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] HTTP exception thrown: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Request method failure captured: Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: request: DELETE /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 HTTP/1.1 Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept: application/json Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Accept-Encoding: identity Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Connection: close Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Length: 0 Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Content-Type: application/json Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Host: 10.222.0.17 Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: Openstack-System-Scope: None Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: User-Agent: python-urllib3/1.26.12 Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Auth-Token: gAAAAABjHScv7ZFT1SnGrjDI2PY0xZVpQwJgL6f66NFIVzkEsgalpf6mTh8hxGyn6Sd85a80ITe6EUsEL81gpl6OCzp757262hpPawwWZcZg_vhmTdCKr8eUpWlwB_ElJqigSoh8ZMXz5Fiubb_XyD5Z1lQYzfE-x6sUi6p3PzFWBK0w1tutaAM Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Id: None Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Domain-Name: None Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Identity-Status: Confirmed Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Is-Admin-Project: True Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Id: default Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Domain-Name: Default Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Project-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Role: member,reader Sep 11 00:16:35.489253 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Roles: member,reader Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a819c981f44e4d21ab8b8289d16c19fb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}] Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-Tenant-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Id: default Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Domain-Name: Default Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Id: aa4f534ee1ab4e639e99b9e4ebbe8363 Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: X-User-Name: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: method: > Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: exception: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.494627 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: action_args: {'id': '3ba7a8eb-372f-4d28-8f68-547e780658a5'} Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:16:35.495510 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.496876 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.498277 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Returning 404 to user: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. {{(pid=121068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:16:35.498277 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-a1a382bf-afc6-43f7-ba4c-391c46860079 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 404 len: 111 microversion: 2.1 time: 0.031305 Sep 11 00:16:35.498277 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 599/1196] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Sep 11 00:16:35 2022] DELETE /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:16:35.499742 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '>' {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:35.500413 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.compute.api [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] [instance: 3ba7a8eb-372f-4d28-8f68-547e780658a5] Fetching instance by UUID {{(pid=121067) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:16:35.506336 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:35.506862 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:35.507299 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:35.507984 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Acquiring lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:16:35.508432 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:16:35.509237 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG oslo_concurrency.lockutils [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Lock "1f4b48d3-0a1e-4042-b9a7-615220ba0b82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:16:35.522104 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.wsgi [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] HTTP exception thrown: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Request method failure captured: Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: request: GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 HTTP/1.1 Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept: application/json Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Accept-Encoding: identity Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Connection: close Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Length: 0 Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Content-Type: application/json Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Host: 10.222.0.17 Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: Openstack-System-Scope: None Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: User-Agent: python-urllib3/1.26.12 Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Auth-Token: gAAAAABjHScv7ZFT1SnGrjDI2PY0xZVpQwJgL6f66NFIVzkEsgalpf6mTh8hxGyn6Sd85a80ITe6EUsEL81gpl6OCzp757262hpPawwWZcZg_vhmTdCKr8eUpWlwB_ElJqigSoh8ZMXz5Fiubb_XyD5Z1lQYzfE-x6sUi6p3PzFWBK0w1tutaAM Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Id: None Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Domain-Name: None Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Identity-Status: Confirmed Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Is-Admin-Project: True Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Id: default Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Domain-Name: Default Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Project-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Role: member,reader Sep 11 00:16:35.523659 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Roles: member,reader Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a819c981f44e4d21ab8b8289d16c19fb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a819c981f44e4d21ab8b8289d16c19fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a819c981f44e4d21ab8b8289d16c19fb"}]}] Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Id: a819c981f44e4d21ab8b8289d16c19fb Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-Tenant-Name: tempest-TestVolumeBootPattern-1283565937 Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Id: default Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Domain-Name: Default Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Id: aa4f534ee1ab4e639e99b9e4ebbe8363 Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: X-User-Name: tempest-TestVolumeBootPattern-1283565937-project Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: method: > Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: exception: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.525192 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: action_args: {'id': '3ba7a8eb-372f-4d28-8f68-547e780658a5'} Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: {{(pid=121067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:16:35.526064 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. Sep 11 00:16:35.527677 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: ERROR nova.api.openstack.wsgi Sep 11 00:16:35.529174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: DEBUG nova.api.openstack.wsgi [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Returning 404 to user: Instance 3ba7a8eb-372f-4d28-8f68-547e780658a5 could not be found. {{(pid=121067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:16:35.529174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: INFO nova.api.openstack.requestlog [None req-6e9d142e-66a8-4688-88c8-318f4040d797 tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5" status: 404 len: 111 microversion: 2.1 time: 0.029294 Sep 11 00:16:35.529174 dv-cinder-852009-6-iscsi devstack@n-api.service[121067]: [pid: 121067|app: 0|req: 598/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Sep 11 00:16:35 2022] GET /compute/v2.1/servers/3ba7a8eb-372f-4d28-8f68-547e780658a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 00:16:37.064299 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: DEBUG nova.api.openstack.wsgi [None req-c8a38f1a-df12-4cee-aa5f-ebd4d835a43d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] Calling method '.version_select at 0x7f5ab67c8670>' {{(pid=121068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:16:37.164060 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: INFO nova.api.openstack.requestlog [None req-c8a38f1a-df12-4cee-aa5f-ebd4d835a43d tempest-TestVolumeBootPattern-1283565937 tempest-TestVolumeBootPattern-1283565937-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-280477967" status: 202 len: 0 microversion: 2.1 time: 0.107148 Sep 11 00:16:37.164658 dv-cinder-852009-6-iscsi devstack@n-api.service[121068]: [pid: 121068|app: 0|req: 600/1198] 10.222.0.17 () {58 vars in 1260 bytes} [Sun Sep 11 00:16:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-280477967 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)